tidytable VS tidyr

If you need speed, you should consider using dtplyr (or tidytable), or even dbplyr with duckdb.

What do you think of this instead?

Here's an example - I use this in a package I've built called tidytable. Here is the as_tidytable() function I use that uses method dispatch.

If you're having performance issues with dplyr you can also try out tidytable

I’d say tidytable is a better option these days as it supports more functions. Although I think dtplyr has improved on this front recently, but still lags. The author of tidytable contributes to dtplyr as well.

I know you said it 'feels much faster' which isn't exactly a data oriented comparison, but tidymodels performs very well. You can see one of the dplyr functions as step_* in tidymodels, for example mutate vs. step_mutate under recipes library. The author of tidytable, which uses data.table, had some revisions due to this conversation, just as an example.

Tidytable is what you might be looking for: https://markfairbanks.github.io/tidytable/, this will require a bit of refactoring (e.g group-bys happen as arguments in summarise/mutate). You'll get data.table like speed in a very compact & complete package.

People can also use tidytable and keep the same workflow they're already used to 😄

This was fun to play around with. I made some very minor changes and posted at https://gist.github.com/hadley/d54895557fbb0fe0402d2277b9011....

It revealed to me that there's a buglet in `forcats::last()` (https://github.com/tidyverse/forcats/issues/303) and made me wonder if `pivot_longer()` should be able to rename the columns as you pivot them (https://github.com/tidyverse/tidyr/issues/1338)

I originally wrote tidytable because dtplyr was missing a lot of functionality my coworkers and I needed, and at the time dtplyr looked like a "forgotten package" (lots of open issues/bugs, very infrequent updates). Hadley Wickham also mentioned at one point [he had no plans for adding tidyr functions)[https://github.com/tidyverse/tidyr/issues/1015#issuecomment-682977139]. He changed his mind on that one - tidyr functions are the ones that I'm in the process of contributing to dtplyr now.