Data wrangling in Elixir with Explorer, the power of Rust, the elegance of R - Launch Week 1 - Day 5
Welcome to the fifth and last day of the first Livebook Launch Week!
Today we will talk about data wrangling with Livebook and the new data capabilities with this new release.
Watch the video where José Valim shows a demo of those new features.
You can also read an overview of the new features below.
Explorer: series and dataframes for fast data exploration in Elixir
Explorer is a project that brings series (one-dimensional data) and data frames (two-dimensional data) right into Elixir.
It is implemented on top of the Polars project, a highly performant dataframe Rust library. And it’s highly inspired by the dplyr project from R, which is quite expressive. We aim to bring ideas from both communities into Elixir to provide a powerful and elegant tool for data processing.
Let’s play with Explorer a little bit.
The first step of a data exploration project is to import the data. Let’s see how you can import a dataset into an Explorer data frame:
After importing the data, it’s usually a good idea to explore it a little bit. To do that, we’ll use a new feature from Livebook that helps us visualize an Explorer Dataframe as a table.
Visualizing an Explorer dataframe as an interactive table
Kino is the library used by Livebook to render rich and interactive outputs directly from your Elixir code. Livebook has multiple built-in Kinos, but anyone can also build custom Kinos as a way to extend Livebook.
We built a new Kino called Kino Explorer for this release to improve the integration between Explorer and Livebook. Let’s see how we can use it to display an Explorer data frame as an interactive table:
Data transformation using the new Data Transform Smart cell
In Livebook, a Smart cell is a UI-based cell that helps you to accomplish a specific task like creating a database connection, sending a message to a Slack channel, or running a Machine Learning model.
Livebook has various built-in Smart cells, and anyone can build a Smart cell to extend Livebook to their needs.
For this release, we built a new built-in Smart cell; the Data Transform one. Let’s see how we can use it for some data transformation.
Want to play with all of those new features?
First, ensure you’ve installed the latest version of Livebook.
Then, click the button below to run the notebook that José Valim built in the demo video:
If you have any comments or want to share what you’ve built using Livebook, you can tweet using the #LivebookLaunchWeek hashtag.
I hope you got as excited as we did with this new Livebook 0.9 release.
Besides that, we’re already working on much more exciting stuff we’re looking forward to sharing—for example, the upcoming Livebook Teams.
If you use or want to use Livebook at work with your colleagues, you can fill in our form to help us to inform Livebook Team’s roadmap and get updates about it.
Thank you very much for being with us these last five days. This is all for this first Livebook Launch Week!
Building Livebook and sharing what it’s capable of is a joy for us. We hope you can have fun with it too. 😄