There’s a concept in R of an analysis as a package, in which everything you need for your data analysis is contained within a custom package. When you install the package and build the vignettes, the data analysis is performed and results saved as a pretty HTML or PDF file, generated with R Markdown. I wanted to extend this concept to a machine learning model as a package.
The idea here is that, using vignettes, we can make equivalent installing a package with training a model. The functions in the package can be used in model training or for scoring new data, probably with some overlap. To demonstrate this I’ve created a simple sentiment analysis model based on review data from the UCI Machine Learning Repository.
You can check out the repository for the model/package here. I’ve also copied the output of the vignette so you can see what’s knitted when the package is installed. You can install this package with devtools::install_github("mdneuzerling/ModelAsAPackage", build_vignettes = TRUE)
. The package can be loaded and attached with library(ModelAsAPackage)
and the training vignette opened with vignette("model-training", package = "ModelAsAPackage")
.
Want to see the (not-so-great) model score some text? Try giving an argument to the sentiment
function. I’m happy to report that sentiment("love") == "good"
.
I thought this might work because of a few things:
- Vignettes are created before the source code is bundled, so in theory we can train a model before the package has finished compiling.
- R uses lazy evaluation, so if a package function refers to an object that doesn’t yet exist (because it hasn’t been created by the vignette) that’s okay.
- I like using the same functions for model training as I do for model scoring, like the
map_to_dtm
function in this package. - I wanted to take full advantage of
roxygen2
for documenting package functions, andtestthat
for unit tests. I especially like the ease with which you can test within RStudio.
However, I have my doubts:
- In order for tests to work, I have to run
devtools::build_vignettes
before runningdevtools::install
. There’s something here with namespaces whereby the data objects suddenly become “unexported” after tests are attempted. I don’t know why! - There are some relative paths in the code. I’m assuming that the working directory is
<package_root>/vignettes
when this vignette is knitted, so I can move up one level to obtain the root directory of the package. This should be okay if we’re following the standard package structure, but I’ve been hurt too many times by relative file paths to feel comfortable about this. - I’m not sure how this would operate with the
plumber
package. I don’t know if we can integrate the expectedplumber.R
function in the package, except for sticking it in theinst
directory and then finding it withsystem.file
. - This all seems like a lot of complexity for not too much benefit. Maybe doing this again would be easier now that I have a template.
These sorts of projects should be shared, even if I don’t think that this is a major success!
A quick shout out for the excellent book on R packages by Hadley Wickham. It’s well worth keeping bookmarked.
Share this post
Twitter
Google+
Facebook
Reddit
LinkedIn
StumbleUpon
Pinterest
Email