skimr

<!DOCTYPE html> <html> <head> <meta charset="utf-8" /> <meta name="generator" content="pandoc" /> <meta http-equiv="X-UA-Compatible" content="IE=EDGE" /> <meta name="viewport" content="width=device-width, initial-scale=1" /> <title>In packages</title> <script>// Pandoc 2.9 adds attributes on both header and div. We remove the former (to // be compatible with the behavior of Pandoc < 2.8). document.addEventListener('DOMContentLoaded', function(e) { var hs = document.querySelectorAll("div.section[class*='level'] > :first-child"); var i, h, a; for (i = 0; i < hs.length; i++) { h = hs[i]; if (!/^h[1-6]$/i.test(h.tagName)) continue; // it should be a header h1-h6 a = h.attributes; while (a.length > 0) h.removeAttribute(a[0].name); } }); </script> <style type="text/css"> code{white-space: pre-wrap;} span.smallcaps{font-variant: small-caps;} span.underline{text-decoration: underline;} div.column{display: inline-block; vertical-align: top; width: 50%;} div.hanging-indent{margin-left: 1.5em; text-indent: -1.5em;} ul.task-list{list-style: none;} </style> <style type="text/css"> code { white-space: pre; } .sourceCode { overflow: visible; } </style> <style type="text/css" data-origin="pandoc"> pre > code.sourceCode { white-space: pre; position: relative; } pre > code.sourceCode > span { display: inline-block; line-height: 1.25; } pre > code.sourceCode > span:empty { height: 1.2em; } .sourceCode { overflow: visible; } code.sourceCode > span { color: inherit; text-decoration: inherit; } div.sourceCode { margin: 1em 0; } pre.sourceCode { margin: 0; } @media screen { div.sourceCode { overflow: auto; } } @media print { pre > code.sourceCode { white-space: pre-wrap; } pre > code.sourceCode > span { text-indent: -5em; padding-left: 5em; } } pre.numberSource code { counter-reset: source-line 0; } pre.numberSource code > span { position: relative; left: -4em; counter-increment: source-line; } pre.numberSource code > span > a:first-child::before { content: counter(source-line); position: relative; left: -1em; text-align: right; vertical-align: baseline; border: none; display: inline-block; -webkit-touch-callout: none; -webkit-user-select: none; -khtml-user-select: none; -moz-user-select: none; -ms-user-select: none; user-select: none; padding: 0 4px; width: 4em; color: #aaaaaa; } pre.numberSource { margin-left: 3em; border-left: 1px solid #aaaaaa; padding-left: 4px; } div.sourceCode { } @media screen { pre > code.sourceCode > span > a:first-child::before { text-decoration: underline; } } code span.al { color: #ff0000; font-weight: bold; } code span.an { color: #60a0b0; font-weight: bold; font-style: italic; } code span.at { color: #7d9029; } code span.bn { color: #40a070; } code span.bu { color: #008000; } code span.cf { color: #007020; font-weight: bold; } code span.ch { color: #4070a0; } code span.cn { color: #880000; } code span.co { color: #60a0b0; font-style: italic; } code span.cv { color: #60a0b0; font-weight: bold; font-style: italic; } code span.do { color: #ba2121; font-style: italic; } code span.dt { color: #902000; } code span.dv { color: #40a070; } code span.er { color: #ff0000; font-weight: bold; } code span.ex { } code span.fl { color: #40a070; } code span.fu { color: #06287e; } code span.im { color: #008000; font-weight: bold; } code span.in { color: #60a0b0; font-weight: bold; font-style: italic; } code span.kw { color: #007020; font-weight: bold; } code span.op { color: #666666; } code span.ot { color: #007020; } code span.pp { color: #bc7a00; } code span.sc { color: #4070a0; } code span.ss { color: #bb6688; } code span.st { color: #4070a0; } code span.va { color: #19177c; } code span.vs { color: #4070a0; } code span.wa { color: #60a0b0; font-weight: bold; font-style: italic; } </style> <script> // apply pandoc div.sourceCode style to pre.sourceCode instead (function() { var sheets = document.styleSheets; for (var i = 0; i < sheets.length; i++) { if (sheets[i].ownerNode.dataset["origin"] !== "pandoc") continue; try { var rules = sheets[i].cssRules; } catch (e) { continue; } var j = 0; while (j < rules.length) { var rule = rules[j]; // check if there is a div.sourceCode rule if (rule.type !== rule.STYLE_RULE || rule.selectorText !== "div.sourceCode") { j++; continue; } var style = rule.style.cssText; // check if color or background-color is set if (rule.style.color === '' && rule.style.backgroundColor === '') { j++; continue; } // replace div.sourceCode by a pre.sourceCode rule sheets[i].deleteRule(j); sheets[i].insertRule('pre.sourceCode{' + style + '}', j); } } })(); </script> <style type="text/css">body { background-color: #fff; margin: 1em auto; max-width: 700px; overflow: visible; padding-left: 2em; padding-right: 2em; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-size: 14px; line-height: 1.35; } #TOC { clear: both; margin: 0 0 10px 10px; padding: 4px; width: 400px; border: 1px solid #CCCCCC; border-radius: 5px; background-color: #f6f6f6; font-size: 13px; line-height: 1.3; } #TOC .toctitle { font-weight: bold; font-size: 15px; margin-left: 5px; } #TOC ul { padding-left: 40px; margin-left: -1.5em; margin-top: 5px; margin-bottom: 5px; } #TOC ul ul { margin-left: -2em; } #TOC li { line-height: 16px; } table { margin: 1em auto; border-width: 1px; border-color: #DDDDDD; border-style: outset; border-collapse: collapse; } table th { border-width: 2px; padding: 5px; border-style: inset; } table td { border-width: 1px; border-style: inset; line-height: 18px; padding: 5px 5px; } table, table th, table td { border-left-style: none; border-right-style: none; } table thead, table tr.even { background-color: #f7f7f7; } p { margin: 0.5em 0; } blockquote { background-color: #f6f6f6; padding: 0.25em 0.75em; } hr { border-style: solid; border: none; border-top: 1px solid #777; margin: 28px 0; } dl { margin-left: 0; } dl dd { margin-bottom: 13px; margin-left: 13px; } dl dt { font-weight: bold; } ul { margin-top: 0; } ul li { list-style: circle outside; } ul ul { margin-bottom: 0; } pre, code { background-color: #f7f7f7; border-radius: 3px; color: #333; white-space: pre-wrap; } pre { border-radius: 3px; margin: 5px 0px 10px 0px; padding: 10px; } pre:not([class]) { background-color: #f7f7f7; } code { font-family: Consolas, Monaco, 'Courier New', monospace; font-size: 85%; } p > code, li > code { padding: 2px 0px; } div.figure { text-align: center; } img { background-color: #FFFFFF; padding: 2px; border: 1px solid #DDDDDD; border-radius: 3px; border: 1px solid #CCCCCC; margin: 0 5px; } h1 { margin-top: 0; font-size: 35px; line-height: 40px; } h2 { border-bottom: 4px solid #f7f7f7; padding-top: 10px; padding-bottom: 2px; font-size: 145%; } h3 { border-bottom: 2px solid #f7f7f7; padding-top: 10px; font-size: 120%; } h4 { border-bottom: 1px solid #f7f7f7; margin-left: 8px; font-size: 105%; } h5, h6 { border-bottom: 1px solid #ccc; font-size: 105%; } a { color: #0033dd; text-decoration: none; } a:hover { color: #6666ff; } a:visited { color: #800080; } a:visited:hover { color: #BB00BB; } a[href^="http:"] { text-decoration: underline; } a[href^="https:"] { text-decoration: underline; } code > span.kw { color: #555; font-weight: bold; } code > span.dt { color: #902000; } code > span.dv { color: #40a070; } code > span.bn { color: #d14; } code > span.fl { color: #d14; } code > span.ch { color: #d14; } code > span.st { color: #d14; } code > span.co { color: #888888; font-style: italic; } code > span.ot { color: #007020; } code > span.al { color: #ff0000; font-weight: bold; } code > span.fu { color: #900; font-weight: bold; } code > span.er { color: #a61717; background-color: #e3d2d2; } </style> </head> <body> <h1 class="title toc-ignore">In packages</h1> <div id="introduction" class="section level2"> <h2>Introduction</h2> This vignette serves two distinct, but related, purposes: <ul> <li>It documents general best practices for using tidyr in a package, inspired by <a href="https://ggplot2.tidyverse.org/dev/articles/ggplot2-in-packages.html">using ggplot2 in packages</a>.</li> <li>It describes migration patterns for the transition from tidyr v0.8.3 to v1.0.0. This release includes breaking changes to <code>nest()</code> and <code>unnest()</code> in order to increase consistency within tidyr and with the rest of the tidyverse.</li> </ul> Before we go on, we’ll attach the packages we use, expose the version of tidyr, and make a small dataset to use in examples. <div class="sourceCode" id="cb1"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb1-1" aria-hidden="true" tabindex="-1"></a>library(tidyr) <a href="#cb1-2" aria-hidden="true" tabindex="-1"></a>library(dplyr, warn.conflicts = FALSE) <a href="#cb1-3" aria-hidden="true" tabindex="-1"></a>library(purrr) <a href="#cb1-4" aria-hidden="true" tabindex="-1"></a> <a href="#cb1-5" aria-hidden="true" tabindex="-1"></a>packageVersion("tidyr") <a href="#cb1-6" aria-hidden="true" tabindex="-1"></a>#> [1] '1.3.0' <a href="#cb1-7" aria-hidden="true" tabindex="-1"></a> <a href="#cb1-8" aria-hidden="true" tabindex="-1"></a>mini_iris <- as_tibble(iris)[c(1, 2, 51, 52, 101, 102), ] <a href="#cb1-9" aria-hidden="true" tabindex="-1"></a>mini_iris <a href="#cb1-10" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 6 × 5 <a href="#cb1-11" aria-hidden="true" tabindex="-1"></a>#> Sepal.Length Sepal.Width Petal.Length Petal.Width Species <a href="#cb1-12" aria-hidden="true" tabindex="-1"></a>#> <dbl> <dbl> <dbl> <dbl> <fct> <a href="#cb1-13" aria-hidden="true" tabindex="-1"></a>#> 1 5.1 3.5 1.4 0.2 setosa <a href="#cb1-14" aria-hidden="true" tabindex="-1"></a>#> 2 4.9 3 1.4 0.2 setosa <a href="#cb1-15" aria-hidden="true" tabindex="-1"></a>#> 3 7 3.2 4.7 1.4 versicolor <a href="#cb1-16" aria-hidden="true" tabindex="-1"></a>#> 4 6.4 3.2 4.5 1.5 versicolor <a href="#cb1-17" aria-hidden="true" tabindex="-1"></a>#> 5 6.3 3.3 6 2.5 virginica <a href="#cb1-18" aria-hidden="true" tabindex="-1"></a>#> 6 5.8 2.7 5.1 1.9 virginica</code></pre></div> </div> <div id="using-tidyr-in-packages" class="section level2"> <h2>Using tidyr in packages</h2> Here we assume that you’re already familiar with using tidyr in functions, as described in <code>vignette("programming.Rmd")</code>. There are two important considerations when using tidyr in a package: <ul> <li>How to avoid <code>R CMD CHECK</code> notes when using fixed variable names.</li> <li>How to alert yourself to upcoming changes in the development version of tidyr.</li> </ul> <div id="fixed-column-names" class="section level3"> <h3>Fixed column names</h3> If you know the column names, this code works in the same way regardless of whether its inside or outside of a package: <div class="sourceCode" id="cb2"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb2-1" aria-hidden="true" tabindex="-1"></a>mini_iris %>% nest( <a href="#cb2-2" aria-hidden="true" tabindex="-1"></a> petal = c(Petal.Length, Petal.Width), <a href="#cb2-3" aria-hidden="true" tabindex="-1"></a> sepal = c(Sepal.Length, Sepal.Width) <a href="#cb2-4" aria-hidden="true" tabindex="-1"></a>) <a href="#cb2-5" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 3 × 3 <a href="#cb2-6" aria-hidden="true" tabindex="-1"></a>#> Species petal sepal <a href="#cb2-7" aria-hidden="true" tabindex="-1"></a>#> <fct> <list> <list> <a href="#cb2-8" aria-hidden="true" tabindex="-1"></a>#> 1 setosa <tibble [2 × 2]> <tibble [2 × 2]> <a href="#cb2-9" aria-hidden="true" tabindex="-1"></a>#> 2 versicolor <tibble [2 × 2]> <tibble [2 × 2]> <a href="#cb2-10" aria-hidden="true" tabindex="-1"></a>#> 3 virginica <tibble [2 × 2]> <tibble [2 × 2]></code></pre></div> But <code>R CMD check</code> will warn about undefined global variables (<code>Petal.Length</code>, <code>Petal.Width</code>, <code>Sepal.Length</code>, and <code>Sepal.Width</code>), because it doesn’t know that <code>nest()</code> is looking for the variables inside of <code>mini_iris</code> (i.e. <code>Petal.Length</code> and friends are data-variables, not env-variables). The easiest way to silence this note is to use <code>all_of()</code>. <code>all_of()</code> is a tidyselect helper (like <code>starts_with()</code>, <code>ends_with()</code>, etc.) that takes column names stored as strings: <div class="sourceCode" id="cb3"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb3-1" aria-hidden="true" tabindex="-1"></a>mini_iris %>% nest( <a href="#cb3-2" aria-hidden="true" tabindex="-1"></a> petal = all_of(c("Petal.Length", "Petal.Width")), <a href="#cb3-3" aria-hidden="true" tabindex="-1"></a> sepal = all_of(c("Sepal.Length", "Sepal.Width")) <a href="#cb3-4" aria-hidden="true" tabindex="-1"></a>) <a href="#cb3-5" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 3 × 3 <a href="#cb3-6" aria-hidden="true" tabindex="-1"></a>#> Species petal sepal <a href="#cb3-7" aria-hidden="true" tabindex="-1"></a>#> <fct> <list> <list> <a href="#cb3-8" aria-hidden="true" tabindex="-1"></a>#> 1 setosa <tibble [2 × 2]> <tibble [2 × 2]> <a href="#cb3-9" aria-hidden="true" tabindex="-1"></a>#> 2 versicolor <tibble [2 × 2]> <tibble [2 × 2]> <a href="#cb3-10" aria-hidden="true" tabindex="-1"></a>#> 3 virginica <tibble [2 × 2]> <tibble [2 × 2]></code></pre></div> Alternatively, you may want to use <code>any_of()</code> if it is OK that some of the specified variables cannot be found in the input data. The <a href="https://tidyselect.r-lib.org">tidyselect</a> package offers an entire family of select helpers. You are probably already familiar with them from using <code>dplyr::select()</code>. </div> <div id="continuous-integration" class="section level3"> <h3>Continuous integration</h3> Hopefully you’ve already adopted continuous integration for your package, in which <code>R CMD check</code> (which includes your own tests) is run on a regular basis, e.g. every time you push changes to your package’s source on GitHub or similar. The tidyverse team currently relies most heavily on GitHub Actions, so that will be our example. <code>usethis::use_github_action()</code> can help you get started. We recommend adding a workflow that targets the devel version of tidyr. When should you do this? <ul> <li>Always? If your package is tightly coupled to tidyr, consider leaving this in place all the time, so you know if changes in tidyr affect your package.</li> <li>Right before a tidyr release? For everyone else, you could add (or re-activate an existing) tidyr-devel workflow during the period preceding a major tidyr release that has the potential for breaking changes, especially if you’ve been contacted during our reverse dependency checks.</li> </ul> Example of a GitHub Actions workflow that tests your package against the development version of tidyr: <div class="sourceCode" id="cb4"><pre class="sourceCode yaml"><code class="sourceCode yaml"><a href="#cb4-1" aria-hidden="true" tabindex="-1"></a>on: <a href="#cb4-2" aria-hidden="true" tabindex="-1"></a> push: <a href="#cb4-3" aria-hidden="true" tabindex="-1"></a> branches: <a href="#cb4-4" aria-hidden="true" tabindex="-1"></a> - main <a href="#cb4-5" aria-hidden="true" tabindex="-1"></a> pull_request: <a href="#cb4-6" aria-hidden="true" tabindex="-1"></a> branches: <a href="#cb4-7" aria-hidden="true" tabindex="-1"></a> - main <a href="#cb4-8" aria-hidden="true" tabindex="-1"></a> <a href="#cb4-9" aria-hidden="true" tabindex="-1"></a>name: R-CMD-check-tidyr-devel <a href="#cb4-10" aria-hidden="true" tabindex="-1"></a> <a href="#cb4-11" aria-hidden="true" tabindex="-1"></a>jobs: <a href="#cb4-12" aria-hidden="true" tabindex="-1"></a> R-CMD-check: <a href="#cb4-13" aria-hidden="true" tabindex="-1"></a> runs-on: macOS-latest <a href="#cb4-14" aria-hidden="true" tabindex="-1"></a> steps: <a href="#cb4-15" aria-hidden="true" tabindex="-1"></a> - uses: actions/checkout@v2 <a href="#cb4-16" aria-hidden="true" tabindex="-1"></a> - uses: r-lib/actions/setup-r@v1 <a href="#cb4-17" aria-hidden="true" tabindex="-1"></a> - name: Install dependencies <a href="#cb4-18" aria-hidden="true" tabindex="-1"></a> run: | <a href="#cb4-19" aria-hidden="true" tabindex="-1"></a> install.packages(c("remotes", "rcmdcheck")) <a href="#cb4-20" aria-hidden="true" tabindex="-1"></a> remotes::install_deps(dependencies = TRUE) <a href="#cb4-21" aria-hidden="true" tabindex="-1"></a> remotes::install_github("tidyverse/tidyr") <a href="#cb4-22" aria-hidden="true" tabindex="-1"></a> shell: Rscript {0} <a href="#cb4-23" aria-hidden="true" tabindex="-1"></a> - name: Check <a href="#cb4-24" aria-hidden="true" tabindex="-1"></a> run: rcmdcheck::rcmdcheck(args = "--no-manual", error_on = "error") <a href="#cb4-25" aria-hidden="true" tabindex="-1"></a> shell: Rscript {0}</code></pre></div> GitHub Actions are an evolving landscape, so you can always mine the workflows for tidyr itself (<a href="https://github.com/tidyverse/tidyr/tree/main/.github/workflows">tidyverse/tidyr/.github/workflows</a>) or the main <a href="https://github.com/r-lib/actions">r-lib/actions</a> repo for ideas. </div> </div> <div id="tidyr-v0.8.3---v1.0.0" class="section level2"> <h2>tidyr v0.8.3 -> v1.0.0</h2> v1.0.0 makes considerable changes to the interface of <code>nest()</code> and <code>unnest()</code> in order to bring them in line with newer tidyverse conventions. I have tried to make the functions as backward compatible as possible and to give informative warning messages, but I could not cover 100% of use cases, so you may need to change your package code. This guide will help you do so with a minimum of pain. Ideally, you’ll tweak your package so that it works with both tidyr 0.8.3 and tidyr 1.0.0. This makes life considerably easier because it means there’s no need to coordinate CRAN submissions - you can submit your package that works with both tidyr versions, before I submit tidyr to CRAN. This section describes our recommend practices for doing so, drawing from the general principles described in <a href="https://design.tidyverse.org/changes-multivers.html" class="uri">https://design.tidyverse.org/changes-multivers.html</a>. If you use continuous integration already, we strongly recommend adding a build that tests with the development version of tidyr; see above for details. This section briefly describes how to run different code for different versions of tidyr, then goes through the major changes that might require workarounds: <ul> <li><code>nest()</code> and <code>unnest()</code> get new interfaces.</li> <li><code>nest()</code> preserves groups.</li> <li><code>nest_()</code> and <code>unnest_()</code> are defunct.</li> </ul> If you’re struggling with a problem that’s not described here, please reach out via <a href="https://github.com/tidyverse/tidyr/issues/new">github</a> or <a href="mailto:hadley@posit.co">email</a> so we can help out. <div id="conditional-code" class="section level3"> <h3>Conditional code</h3> Sometimes you’ll be able to write code that works with v0.8.3 and v1.0.0. But this often requires code that’s not particularly natural for either version and you’d be better off to (temporarily) have separate code paths, each containing non-contrived code. You get to re-use your existing code in the “old” branch, which will eventually be phased out, and write clean, forward-looking code in the “new” branch. The basic approach looks like this. First you define a function that returns <code>TRUE</code> for new versions of tidyr: <div class="sourceCode" id="cb5"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb5-1" aria-hidden="true" tabindex="-1"></a>tidyr_new_interface <- function() { <a href="#cb5-2" aria-hidden="true" tabindex="-1"></a> packageVersion("tidyr") > "0.8.99" <a href="#cb5-3" aria-hidden="true" tabindex="-1"></a>}</code></pre></div> We highly recommend keeping this as a function because it provides an obvious place to jot any transition notes for your package, and it makes it easier to remove transitional code later on. Another benefit is that the tidyr version is determined at run time, not at build time, and will therefore detect your user’s current tidyr version. Then in your functions, you use an <code>if</code> statement to call different code for different versions: <div class="sourceCode" id="cb6"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb6-1" aria-hidden="true" tabindex="-1"></a>my_function_inside_a_package <- function(...) <a href="#cb6-2" aria-hidden="true" tabindex="-1"></a> # my code here <a href="#cb6-3" aria-hidden="true" tabindex="-1"></a> <a href="#cb6-4" aria-hidden="true" tabindex="-1"></a> if (tidyr_new_interface()) { <a href="#cb6-5" aria-hidden="true" tabindex="-1"></a> # Freshly written code for v1.0.0 <a href="#cb6-6" aria-hidden="true" tabindex="-1"></a> out <- tidyr::nest(df, data = any_of(c("x", "y", "z"))) <a href="#cb6-7" aria-hidden="true" tabindex="-1"></a> } else { <a href="#cb6-8" aria-hidden="true" tabindex="-1"></a> # Existing code for v0.8.3 <a href="#cb6-9" aria-hidden="true" tabindex="-1"></a> out <- tidyr::nest(df, x, y, z) <a href="#cb6-10" aria-hidden="true" tabindex="-1"></a> } <a href="#cb6-11" aria-hidden="true" tabindex="-1"></a> <a href="#cb6-12" aria-hidden="true" tabindex="-1"></a> # more code here <a href="#cb6-13" aria-hidden="true" tabindex="-1"></a>}</code></pre></div> If your new code uses a function that only exists in tidyr 1.0.0, you will get a <code>NOTE</code> from <code>R CMD check</code>: this is one of the few notes that you can explain in your CRAN submission comments. Just mention that it’s for forward compatibility with tidyr 1.0.0, and CRAN will let your package through. </div> <div id="new-syntax-for-nest" class="section level3"> <h3>New syntax for <code>nest()</code></h3> What changed: <ul> <li>The to-be-nested columns are no longer accepted as “loose parts”.</li> <li>The new list-column’s name is no longer provided via the <code>.key</code> argument.</li> <li>Now we use a construct like this: <code>new_col = <something about existing cols></code>.</li> </ul> Why it changed: <ul> <li>The use of <code>...</code> for metadata is a problematic pattern we’re moving away from. <a href="https://design.tidyverse.org/dots-data.html" class="uri">https://design.tidyverse.org/dots-data.html</a></li> <li>The <code>new_col = <something about existing cols></code> construct lets us create multiple nested list-columns at once (“multi-nest”). <div class="sourceCode" id="cb7"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb7-1" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb7-2" aria-hidden="true" tabindex="-1"></a> nest(petal = matches("Petal"), sepal = matches("Sepal")) <a href="#cb7-3" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 3 × 3 <a href="#cb7-4" aria-hidden="true" tabindex="-1"></a>#> Species petal sepal <a href="#cb7-5" aria-hidden="true" tabindex="-1"></a>#> <fct> <list> <list> <a href="#cb7-6" aria-hidden="true" tabindex="-1"></a>#> 1 setosa <tibble [2 × 2]> <tibble [2 × 2]> <a href="#cb7-7" aria-hidden="true" tabindex="-1"></a>#> 2 versicolor <tibble [2 × 2]> <tibble [2 × 2]> <a href="#cb7-8" aria-hidden="true" tabindex="-1"></a>#> 3 virginica <tibble [2 × 2]> <tibble [2 × 2]></code></pre></div></li> </ul> Before and after examples: <div class="sourceCode" id="cb8"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb8-1" aria-hidden="true" tabindex="-1"></a># v0.8.3 <a href="#cb8-2" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb8-3" aria-hidden="true" tabindex="-1"></a> nest(Sepal.Length, Sepal.Width, Petal.Length, Petal.Width, .key = "my_data") <a href="#cb8-4" aria-hidden="true" tabindex="-1"></a> <a href="#cb8-5" aria-hidden="true" tabindex="-1"></a># v1.0.0 <a href="#cb8-6" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb8-7" aria-hidden="true" tabindex="-1"></a> nest(my_data = c(Sepal.Length, Sepal.Width, Petal.Length, Petal.Width)) <a href="#cb8-8" aria-hidden="true" tabindex="-1"></a> <a href="#cb8-9" aria-hidden="true" tabindex="-1"></a># v1.0.0 avoiding R CMD check NOTE <a href="#cb8-10" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb8-11" aria-hidden="true" tabindex="-1"></a> nest(my_data = any_of(c("Sepal.Length", "Sepal.Width", "Petal.Length", "Petal.Width"))) <a href="#cb8-12" aria-hidden="true" tabindex="-1"></a> <a href="#cb8-13" aria-hidden="true" tabindex="-1"></a># or equivalently: <a href="#cb8-14" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb8-15" aria-hidden="true" tabindex="-1"></a> nest(my_data = !any_of("Species"))</code></pre></div> If you need a quick and dirty fix without having to think, just call <code>nest_legacy()</code> instead of <code>nest()</code>. It’s the same as <code>nest()</code> in v0.8.3: <div class="sourceCode" id="cb9"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb9-1" aria-hidden="true" tabindex="-1"></a>if (tidyr_new_interface()) { <a href="#cb9-2" aria-hidden="true" tabindex="-1"></a> out <- tidyr::nest_legacy(df, x, y, z) <a href="#cb9-3" aria-hidden="true" tabindex="-1"></a>} else { <a href="#cb9-4" aria-hidden="true" tabindex="-1"></a> out <- tidyr::nest(df, x, y, z) <a href="#cb9-5" aria-hidden="true" tabindex="-1"></a>}</code></pre></div> </div> <div id="new-syntax-for-unnest" class="section level3"> <h3>New syntax for <code>unnest()</code></h3> What changed: <ul> <li>The to-be-unnested columns must now be specified explicitly, instead of defaulting to all list-columns. This also deprecates <code>.drop</code> and <code>.preserve</code>.</li> <li><code>.sep</code> has been deprecated and replaced with <code>names_sep</code>.</li> <li><code>unnest()</code> uses the <a href="https://www.tidyverse.org/blog/2019/01/tibble-2.0.1/#name-repair">emerging tidyverse standard</a> to disambiguate duplicated names. Use <code>names_repair = tidyr_legacy</code> to request the previous approach.</li> <li><code>.id</code> has been deprecated because it can be easily replaced by creating the column of names prior to <code>unnest()</code>, e.g. with an upstream call to <code>mutate()</code>. <div class="sourceCode" id="cb10"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb10-1" aria-hidden="true" tabindex="-1"></a># v0.8.3 <a href="#cb10-2" aria-hidden="true" tabindex="-1"></a>df %>% unnest(x, .id = "id") <a href="#cb10-3" aria-hidden="true" tabindex="-1"></a> <a href="#cb10-4" aria-hidden="true" tabindex="-1"></a># v1.0.0 <a href="#cb10-5" aria-hidden="true" tabindex="-1"></a>df %>% mutate(id = names(x)) %>% unnest(x))</code></pre></div></li> </ul> Why it changed: <ul> <li>The use of <code>...</code> for metadata is a problematic pattern we’re moving away from. <a href="https://design.tidyverse.org/dots-data.html" class="uri">https://design.tidyverse.org/dots-data.html</a></li> <li>The changes to details arguments relate to features rolling out across multiple packages in the tidyverse. For example, <code>ptype</code> exposes prototype support from the new <a href="https://vctrs.r-lib.org">vctrs package</a>. <code>names_repair</code> specifies what to do about duplicated or non-syntactic names, consistent with tibble and readxl.</li> </ul> Before and after: <div class="sourceCode" id="cb11"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb11-1" aria-hidden="true" tabindex="-1"></a>nested <- mini_iris %>% <a href="#cb11-2" aria-hidden="true" tabindex="-1"></a> nest(my_data = c(Sepal.Length, Sepal.Width, Petal.Length, Petal.Width)) <a href="#cb11-3" aria-hidden="true" tabindex="-1"></a> <a href="#cb11-4" aria-hidden="true" tabindex="-1"></a># v0.8.3 automatically unnests list-cols <a href="#cb11-5" aria-hidden="true" tabindex="-1"></a>nested %>% unnest() <a href="#cb11-6" aria-hidden="true" tabindex="-1"></a> <a href="#cb11-7" aria-hidden="true" tabindex="-1"></a># v1.0.0 must be told which columns to unnest <a href="#cb11-8" aria-hidden="true" tabindex="-1"></a>nested %>% unnest(any_of("my_data"))</code></pre></div> If you need a quick and dirty fix without having to think, just call <code>unnest_legacy()</code> instead of <code>unnest()</code>. It’s the same as <code>unnest()</code> in v0.8.3: <div class="sourceCode" id="cb12"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb12-1" aria-hidden="true" tabindex="-1"></a>if (tidyr_new_interface()) { <a href="#cb12-2" aria-hidden="true" tabindex="-1"></a> out <- tidyr::unnest_legacy(df) <a href="#cb12-3" aria-hidden="true" tabindex="-1"></a>} else { <a href="#cb12-4" aria-hidden="true" tabindex="-1"></a> out <- tidyr::unnest(df) <a href="#cb12-5" aria-hidden="true" tabindex="-1"></a>}</code></pre></div> </div> <div id="nest-preserves-groups" class="section level3"> <h3><code>nest()</code> preserves groups</h3> What changed: <ul> <li><code>nest()</code> now preserves the groups present in the input.</li> </ul> Why it changed: <ul> <li>To reflect the growing support for grouped data frames, especially in recent releases of dplyr. See, for example, <code>dplyr::group_modify()</code>, <code>group_map()</code>, and friends.</li> </ul> If the fact that <code>nest()</code> now preserves groups is problematic downstream, you have a few choices: <ul> <li>Apply <code>ungroup()</code> to the result. This level of pragmatism suggests, however, you should at least consider the next two options.</li> <li>You should never have grouped in the first place. Eliminate the <code>group_by()</code> call and specify which columns should be nested versus not nested directly in <code>nest()</code>.</li> <li>Adjust the downstream code to accommodate grouping.</li> </ul> Imagine we used <code>group_by()</code> then <code>nest()</code> on <code>mini_iris</code>, then we computed on the list-column outside the data frame. <div class="sourceCode" id="cb13"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb13-1" aria-hidden="true" tabindex="-1"></a>(df <- mini_iris %>% <a href="#cb13-2" aria-hidden="true" tabindex="-1"></a> group_by(Species) %>% <a href="#cb13-3" aria-hidden="true" tabindex="-1"></a> nest()) <a href="#cb13-4" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 3 × 2 <a href="#cb13-5" aria-hidden="true" tabindex="-1"></a>#> # Groups: Species [3] <a href="#cb13-6" aria-hidden="true" tabindex="-1"></a>#> Species data <a href="#cb13-7" aria-hidden="true" tabindex="-1"></a>#> <fct> <list> <a href="#cb13-8" aria-hidden="true" tabindex="-1"></a>#> 1 setosa <tibble [2 × 4]> <a href="#cb13-9" aria-hidden="true" tabindex="-1"></a>#> 2 versicolor <tibble [2 × 4]> <a href="#cb13-10" aria-hidden="true" tabindex="-1"></a>#> 3 virginica <tibble [2 × 4]> <a href="#cb13-11" aria-hidden="true" tabindex="-1"></a>(external_variable <- map_int(df$data, nrow)) <a href="#cb13-12" aria-hidden="true" tabindex="-1"></a>#> [1] 2 2 2</code></pre></div> And now we try to add that back to the data post hoc: <div class="sourceCode" id="cb14"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb14-1" aria-hidden="true" tabindex="-1"></a>df %>% <a href="#cb14-2" aria-hidden="true" tabindex="-1"></a> mutate(n_rows = external_variable) <a href="#cb14-3" aria-hidden="true" tabindex="-1"></a>#> Error in `mutate()`: <a href="#cb14-4" aria-hidden="true" tabindex="-1"></a>#> ℹ In argument: `n_rows = external_variable`. <a href="#cb14-5" aria-hidden="true" tabindex="-1"></a>#> ℹ In group 1: `Species = setosa`. <a href="#cb14-6" aria-hidden="true" tabindex="-1"></a>#> Caused by error: <a href="#cb14-7" aria-hidden="true" tabindex="-1"></a>#> ! `n_rows` must be size 1, not 3.</code></pre></div> This fails because <code>df</code> is grouped and <code>mutate()</code> is group-aware, so it’s hard to add a completely external variable. Other than pragmatically <code>ungroup()</code>ing, what can we do? One option is to work inside the data frame, i.e. bring the <code>map()</code> inside the <code>mutate()</code>, and design the problem away: <div class="sourceCode" id="cb15"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb15-1" aria-hidden="true" tabindex="-1"></a>df %>% <a href="#cb15-2" aria-hidden="true" tabindex="-1"></a> mutate(n_rows = map_int(data, nrow)) <a href="#cb15-3" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 3 × 3 <a href="#cb15-4" aria-hidden="true" tabindex="-1"></a>#> # Groups: Species [3] <a href="#cb15-5" aria-hidden="true" tabindex="-1"></a>#> Species data n_rows <a href="#cb15-6" aria-hidden="true" tabindex="-1"></a>#> <fct> <list> <int> <a href="#cb15-7" aria-hidden="true" tabindex="-1"></a>#> 1 setosa <tibble [2 × 4]> 2 <a href="#cb15-8" aria-hidden="true" tabindex="-1"></a>#> 2 versicolor <tibble [2 × 4]> 2 <a href="#cb15-9" aria-hidden="true" tabindex="-1"></a>#> 3 virginica <tibble [2 × 4]> 2</code></pre></div> If, somehow, the grouping seems appropriate AND working inside the data frame is not an option, <code>tibble::add_column()</code> is group-unaware. It lets you add external data to a grouped data frame. <div class="sourceCode" id="cb16"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb16-1" aria-hidden="true" tabindex="-1"></a>df %>% <a href="#cb16-2" aria-hidden="true" tabindex="-1"></a> tibble::add_column(n_rows = external_variable) <a href="#cb16-3" aria-hidden="true" tabindex="-1"></a>#> # A tibble: 3 × 3 <a href="#cb16-4" aria-hidden="true" tabindex="-1"></a>#> # Groups: Species [3] <a href="#cb16-5" aria-hidden="true" tabindex="-1"></a>#> Species data n_rows <a href="#cb16-6" aria-hidden="true" tabindex="-1"></a>#> <fct> <list> <int> <a href="#cb16-7" aria-hidden="true" tabindex="-1"></a>#> 1 setosa <tibble [2 × 4]> 2 <a href="#cb16-8" aria-hidden="true" tabindex="-1"></a>#> 2 versicolor <tibble [2 × 4]> 2 <a href="#cb16-9" aria-hidden="true" tabindex="-1"></a>#> 3 virginica <tibble [2 × 4]> 2</code></pre></div> </div> <div id="nest_-and-unnest_-are-defunct" class="section level3"> <h3><code>nest_()</code> and <code>unnest_()</code> are defunct</h3> What changed: <ul> <li><code>nest_()</code> and <code>unnest_()</code> no longer work</li> </ul> Why it changed: <ul> <li>We are transitioning the whole tidyverse to the powerful tidy eval framework. Therefore, we are gradually removing all previous solutions: <ul> <li>Specialized standard evaluation versions of functions, e.g., <code>foo_()</code> as a complement to <code>foo()</code>.</li> <li>The older lazyeval framework.</li> </ul></li> </ul> Before and after: <div class="sourceCode" id="cb17"><pre class="sourceCode r"><code class="sourceCode r"><a href="#cb17-1" aria-hidden="true" tabindex="-1"></a># v0.8.3 <a href="#cb17-2" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb17-3" aria-hidden="true" tabindex="-1"></a> nest_( <a href="#cb17-4" aria-hidden="true" tabindex="-1"></a> key_col = "my_data", <a href="#cb17-5" aria-hidden="true" tabindex="-1"></a> nest_cols = c("Sepal.Length", "Sepal.Width", "Petal.Length", "Petal.Width") <a href="#cb17-6" aria-hidden="true" tabindex="-1"></a> ) <a href="#cb17-7" aria-hidden="true" tabindex="-1"></a> <a href="#cb17-8" aria-hidden="true" tabindex="-1"></a>nested %>% unnest_(~ my_data) <a href="#cb17-9" aria-hidden="true" tabindex="-1"></a> <a href="#cb17-10" aria-hidden="true" tabindex="-1"></a># v1.0.0 <a href="#cb17-11" aria-hidden="true" tabindex="-1"></a>mini_iris %>% <a href="#cb17-12" aria-hidden="true" tabindex="-1"></a> nest(my_data = any_of(c("Sepal.Length", "Sepal.Width", "Petal.Length", "Petal.Width"))) <a href="#cb17-13" aria-hidden="true" tabindex="-1"></a> <a href="#cb17-14" aria-hidden="true" tabindex="-1"></a>nested %>% unnest(any_of("my_data"))</code></pre></div> </div> </div>  <!-- dynamically load mathjax for compatibility wit