I recently bought a Google Chromebook. It’s light, it’s fast, great battery, but it doesn’t support all the development tools that I’m used to when working on a Windows computer. There’s no Visual Studio Code (Python) and no RStudio (R). Me being a data scientist, that hurt in the beginning.… Read More »Data Science in the Cloud: Azure Notebooks + GitHub
Getting a firm understanding of NaNs in your dataset ensures you don’t draw wrong conclusions from an incomplete dataset. In this blog post I show how you can list the amount of NaNs per column, per row, and per group. First, let’s create some dummy data, and add some NaNs.… Read More »Working with NaN’s (nulls/NA’s) in pandas: per column, per row and per group
Without going into detail, here’s something I truly hate in R: replacing multiple values. In Python’s pandas, it’s really easy. In this blog post I try several methods: list comprehension, apply(), replace() and map(). First, let’s create some dummy data. First, let’s try with list comprehension. The get() function tries… Read More »Replacing multiple values in a pandas DataFrame column
Here’s another post about seemingly convenient things in pandas. Let’s produce a DataFrame from partially matched columns from another DataFrame. Let’s create some dummy data. Let’s say we are trying to select the columns that contain the world ‘color’. Here’s a solution I found on the web. By converting the… Read More »Partial match of pandas DataFrame column name
Having R as my data science lingua franca, some things in pandas feel less intuitive. As I’m slowly transitioning to pandas, I’ll be posting a lot of examples over the next couple of weeks. Here’s the first one: concatenating columns values of a pandas DataFrame into another (new) column. First… Read More »Concatenating column values in pandas
I’ve done a lot of web scraping in my life. Recently, I started using Google Cloud Platform to automate these kind of jobs. In this blog post I explain how to do it. Throughout this article I scrape the comments, categories and tags of the top clips on the popular… Read More »Web scraping with Google Cloud Functions, Pub/Sub, DataFlow & BigQuery
In this blog post, I describe to ways to deal with code you do not want to run when it is sourced from an external file in R. When Python sources code it does a particular thing, it assigns the string ‘__main__’ to the __name__ variable in that code. However,… Read More »An R equivalent for Python’s if __name__ == ‘__main__’
In this blog post I explain how to create a DataGenerator with a one-hot encoder to encode your labels in the same way for every batch. Some months ago, I tried training a text generator on a huge corpus of text with an LSTM model. Basically, it’s a model that… Read More »One-hot encoding with a TensorFlow DataGenerator
Out of the blue, when coding Python in Visual Studio Code, you might run into the following error. “inconsistent use of tabs and spaces in indentation” This happens, because somewhere in your code, indentation is different than in the rest of your code. Generally, Python doesn’t care what kind of… Read More »Solving “inconsistent use of tabs and spaces in indentation” in Visual Studio Code
In this small blog post I explain how you can work with a virtual environment in Thonny on a Raspberry Pi. But first, let’s create a virtual environment using venv. Open the terminal Change directory to the folder of your project (cd), or create a new one (mkdir) Inside that… Read More »Associate Thonny with a Virtual Environment on Raspberry Pi