Author: Mark Rieke
License:
MIT
{workboots} is a tidy method of generating bootstrap prediction
intervals for arbitrary model types from a tidymodel workflow.
By using bootstrap resampling, we can create many models — one for each resample. Each model will be slightly different based on the resample it was trained on. Each model will also generate slightly different predictions for new data, allowing us to generate a prediction distribution for models that otherwise just return point predictions.
You can install the released version of workboots from CRAN or the development version from github with the devtools or remotes package:
# install from CRAN
install.packages("workboots")
# or the development version
devtools::install_github("markjrieke/workboots")workboots builds on top of the {tidymodels} suite of packages.
Teaching how to use tidymodels is beyond the scope of this package, but
some helpful resources are linked at the bottom of this README.
To get started, we’ll need to create a workflow.
library(tidymodels)
# load our dataset
data("penguins")
penguins <- penguins %>% drop_na()
# split data into testing & training sets
set.seed(123)
penguins_split <- initial_split(penguins)
penguins_test <- testing(penguins_split)
penguins_train <- training(penguins_split)
# create a workflow
penguins_wf <-
workflow() %>%
add_recipe(recipe(body_mass_g ~ ., data = penguins_train) %>% step_dummy(all_nominal())) %>%
add_model(boost_tree("regression"))Boosted tree models can only generate point predictions, but with
workboots we can generate a prediction interval for each observation in
penguins_test by passing the workflow to predict_boots():
library(workboots)
# generate predictions from 2000 bootstrap models
set.seed(345)
penguins_pred_int <-
penguins_wf %>%
predict_boots(
n = 2000,
training_data = penguins_train,
new_data = penguins_test
)
# summarise predictions with a 95% prediction interval
pengins_pred_int %>%
summarise_predictions()#> # A tibble: 84 × 5
#> rowid .preds .pred .pred_lower .pred_upper
#> <int> <list> <dbl> <dbl> <dbl>
#> 1 1 <tibble [2,000 × 2]> 3465. 2913. 3994.
#> 2 2 <tibble [2,000 × 2]> 3535. 2982. 4100.
#> 3 3 <tibble [2,000 × 2]> 3604. 3050. 4187.
#> 4 4 <tibble [2,000 × 2]> 4157. 3477. 4764.
#> 5 5 <tibble [2,000 × 2]> 3868. 3305. 4372.
#> 6 6 <tibble [2,000 × 2]> 3519. 2996. 4078.
#> 7 7 <tibble [2,000 × 2]> 3435. 2914. 3954.
#> 8 8 <tibble [2,000 × 2]> 4072. 3483. 4653.
#> 9 9 <tibble [2,000 × 2]> 3445. 2926. 3966.
#> 10 10 <tibble [2,000 × 2]> 3405. 2876. 3938.
#> # ℹ 74 more rows
Alternatively, we can generate a confidence interval around each
prediction by setting the parameter interval to "confidence":
# generate predictions from 2000 bootstrap models
set.seed(456)
penguins_conf_int <-
penguins_wf %>%
predict_boots(
n = 2000,
training_data = penguins_train,
new_data = penguins_test,
interval = "confidence"
)
# summarise with a 95% confidence interval
penguins_conf_int %>%
summarise_predictions()#> # A tibble: 84 × 5
#> rowid .preds .pred .pred_lower .pred_upper
#> <int> <list> <dbl> <dbl> <dbl>
#> 1 1 <tibble [2,000 × 2]> 3466. 3257. 3635.
#> 2 2 <tibble [2,000 × 2]> 3534. 3291. 3811.
#> 3 3 <tibble [2,000 × 2]> 3623. 3306. 3921.
#> 4 4 <tibble [2,000 × 2]> 4155. 3722. 4504.
#> 5 5 <tibble [2,000 × 2]> 3868. 3644. 4086.
#> 6 6 <tibble [2,000 × 2]> 3509. 3286. 3768.
#> 7 7 <tibble [2,000 × 2]> 3439. 3249. 3624.
#> 8 8 <tibble [2,000 × 2]> 4064. 3737. 4369.
#> 9 9 <tibble [2,000 × 2]> 3450. 3253. 3635.
#> 10 10 <tibble [2,000 × 2]> 3405. 3222. 3651.
#> # ℹ 74 more rows
If you notice a bug, want to request a new feature, or have recommendations on improving documentation, please open an issue in this repository.
- Getting started with Tidymodels
- Tidy Modeling with R
- Julia Silge’s Blog provides use cases of tidymodels with weekly #tidytuesday datasets.
The hex logo for workboots was designed by Sarah Power.