As a data scientist, I usually get a data warehouse to work with. The data’s there and I don’t have to worry about the architecture. However, now and then, I need to get my hands dirty. Lastly, I needed SnowSQL and I couldn’t get it to work, due to an…
I ran into another silly error, for which I wanted to share the solution in order to save you some time. It occurs when trying to run a query using Python’s SQLAlchemy libary. Let’s dive right in. The problem When you’re trying to run a query, either by using Pandas’…
Recently, I’ve been working with Hive a lot and I bumped into this simple thing that I wasn’t aware of existed in SQL. So I decided to share in this blog post. Let’s say you need to extract a month from a timestamp. The following code snippet will return a…
For my latest assignment, I have to work with PostGIS/Postgres a lot. I tried a query that inserts the result of a SELECT statement into a new table. However, I ran into a peculiar error. The error I ran into was: A scenario where this error can arise is when…
In this blog post we’ll calculate the share of a row per group. There are multiple ways to do this: with aggregate functions and with analytic functions. We’ll go over both and demonstrate how analytic functions are far superior in terms of readability. First, let’s create a table to demonstrate…
One of Google’s latest acquisitions, ELT data orchestration tool Dataform, supports JavaScript. This is a great way to chain Dataform’s actions. In this blog post we explore how to automatically create a destination table in your data warehouse, before an incremental definition is run. If you are interested in a…
With the acquisition of Dataform by Google, it is steadily becoming the ELT data orchestration tool par préférence. In this blog post we explore how to automatically create a table in your data warehouse that will function as an incremental data destination in Dataform. If you are interested in a…
In this blog post, I elaborate on two specific operations you’ll run into when using dates in BigQuery. Subtracting an interval from a data and calculating the difference between two dates. Subtracting a unit Subtracting a specific amount of days, weeks, months, quarters, or years from a date can be…
Zoho Analytics is created by Indian-based Zoho, which generated some estimated 500 million in revenue in 2019. Using Zoho Analytics provides the largest synergies when your company uses other products from the Zoho product suite (such as Zoho CRM or SalesIQ). However, Zoho Analytics’ target audience clearly goes beyond its…
I’m a huge fan of Google Cloud Platform because of its intuitive interface and the extremely precise documentation that Google has published regarding its cloud tools. However, there was one error that lost me half an hour of my life when trying to upload a CSV to a PostgreSQL database.…