One of the most fundamental tools for evaluating classifiers is the confusion matrix. In this blog post, I elaborate on how to generate a confusion matrix in R using the tidymodels ecosystem. First, I create a classifier to predict the income class for the very popular adult data set. From…
In this blog post, I discuss the difference between several BigQuery functions that appear to do the same: JSON_EXTRACT and JSON_QUERY — and their value counterparts JSON_EXTRACT_SCALAR and JSON_VALUE. MPP Data Warehouses are increasingly becoming data lakes. In this light, extracting strings/values from semistructured data (stored as a JSON STRING)…
I’m a data scientist. Deploying is not part of my core skills, but something I need to be able to do when working on hobby projects. I recently embraced DigitalOcean to deploy my Django (Python) Project and want to elaborate on a problem I ran into. The error that appeared…
I recently got my hands on an invitation for Hex. Not only do they produce great blog posts, they also offer a product for a specific data science niche. The common issue with data science notebooks is that they are hard to translate to a compelling story for a not-so-tech-savvy…
This is a blog post about a very specific topic. I wanted to filter a data frame on a set of strings that I wanted to match partially. Let’s dive right in. Matching partially is fairly easy, and there are many libraries to choose from, with grepl and str_detect the…
Selligent is an ecosystem of marketing tools, mostly known for it’s marketing automation platform formerly known as Campaign. I was never a big fan of Selligent because it used to be a very closed ecosystem. However, it made available a wide range of APIs recently, allowing you to query its…
Nothing more frustrating in a data science project than a library that doesn’t work in your particular Python version. Sometimes, you just need to install a virtual environment with another Python version. First of all, if you are a venv user, I hate to break it to you. There’s no…
JSON or JavaScript Object Notation is a popular file format for storing semi-structured data. Transforming it to a table is not always easy and sometimes downright ridiculous. However, Pandas offers the possibility via the read_json function. If you are not familiar with the orient argument, you might have a hard…
Brief blog post on a silly Python error. I’m still working on my ML project started hypertuning my sklearn pipeline — manually. To set the parameters of my pipeline in every iteration, I had to use set_params. My estimator is called model_pipeline and I needed to set the parameters via…
Escape ’til infinity — removing or replacing backslashes in a string can be burdensome in any programming language, if you’re not familiar what regex library is below the hood. In this post, we’ll remove a backslash from a string in R. Using gsub, there’s two paradigms to choose from. The…