Without going into detail, here’s something I truly hate in R: replacing multiple values. In Python’s pandas, it’s really easy. In this blog post I try several methods: list comprehension, apply(), replace() and map(). First, let’s create some dummy data. First, let’s try with list comprehension. The get() function tries…
Here’s another post about seemingly convenient things in pandas. Let’s produce a DataFrame from partially matched columns from another DataFrame. Let’s create some dummy data. Let’s say we are trying to select the columns that contain the world ‘color’. Here’s a solution I found on the web. By converting the…
Having R as my data science lingua franca, some things in pandas feel less intuitive. As I’m slowly transitioning to pandas, I’ll be posting a lot of examples over the next couple of weeks. Here’s the first one: concatenating columns values of a pandas DataFrame into another (new) column. First…
Oftentimes, it happens I need to calculate the difference of something between two periods. If each row represents a period, the fastest thing to do is to lag the variable you need to perform calculations on. In R, the lag() function from the stats package is an option, but you’ll…
Sometimes I create reports or analyses that I would like to run on a monthly base. It saves some time if I can simply let the report run, without you having to edit any variables. Lubridate has two really cool functions to get the first day or the last day…
I’ve done a lot of web scraping in my life. Recently, I started using Google Cloud Platform to automate these kind of jobs. In this blog post I explain how to do it. Throughout this article I scrape the comments, categories and tags of the top clips on the popular…
In this blog post, I describe to ways to deal with code you do not want to run when it is sourced from an external file in R. When Python sources code it does a particular thing, it assigns the string ‘__main__’ to the __name__ variable in that code. However,…
When you’re trying to access a CSV file stored in Google Cloud Storage when submitting a job to AI Platform, your first reflex is probably to use pandas’ read_csv. However, this will produce the following error: ImportError: The gcsfs library is required to handle GCS files That’s because pandas is…
In this blog post I explain how to create a DataGenerator with a one-hot encoder to encode your labels in the same way for every batch. Some months ago, I tried training a text generator on a huge corpus of text with an LSTM model. Basically, it’s a model that…
Out of the blue, when coding Python in Visual Studio Code, you might run into the following error. “inconsistent use of tabs and spaces in indentation” This happens, because somewhere in your code, indentation is different than in the rest of your code. Generally, Python doesn’t care what kind of…