Without going into detail, here’s something I truly hate in R: replacing multiple values. In Python’s pandas, it’s really easy. In this blog post I try several methods: list comprehension, apply(), replace() and map(). First, let’s create some dummy data. First, let’s try with list comprehension. The get() function tries…
Here’s another post about seemingly convenient things in pandas. Let’s produce a DataFrame from partially matched columns from another DataFrame. Let’s create some dummy data. Let’s say we are trying to select the columns that contain the world ‘color’. Here’s a solution I found on the web. By converting the…
Having R as my data science lingua franca, some things in pandas feel less intuitive. As I’m slowly transitioning to pandas, I’ll be posting a lot of examples over the next couple of weeks. Here’s the first one: concatenating columns values of a pandas DataFrame into another (new) column. First…
I’ve done a lot of web scraping in my life. Recently, I started using Google Cloud Platform to automate these kind of jobs. In this blog post I explain how to do it. Throughout this article I scrape the comments, categories and tags of the top clips on the popular…
In this blog post, I describe to ways to deal with code you do not want to run when it is sourced from an external file in R. When Python sources code it does a particular thing, it assigns the string ‘__main__’ to the __name__ variable in that code. However,…
In this blog post I explain how to create a DataGenerator with a one-hot encoder to encode your labels in the same way for every batch. Some months ago, I tried training a text generator on a huge corpus of text with an LSTM model. Basically, it’s a model that…
Out of the blue, when coding Python in Visual Studio Code, you might run into the following error. “inconsistent use of tabs and spaces in indentation” This happens, because somewhere in your code, indentation is different than in the rest of your code. Generally, Python doesn’t care what kind of…
In this small blog post I explain how you can work with a virtual environment in Thonny on a Raspberry Pi. But first, let’s create a virtual environment using venv. Open the terminal Change directory to the folder of your project (cd), or create a new one (mkdir) Inside that…
In this blog post I decompose a time series of monthly data using the pandas and statsmodels package in Python. You can find the data that I use in this blog post in my github repo. It is a monthly average of daily car counts on different hubs on the…
Pandas is the go-to package for anything data science in Python. However, if you’re used to R and the convenience of dplyr or data.table, pandas can be confusing, now and then. For example, the following error is a real newb issue. ValueError: You are trying to merge on object and…