Open in app

Sign In

Write

Sign In

Jim Barlow
Jim Barlow

161 Followers

Home

About

Published in Towards Data Science

·Aug 5, 2022

How to Build a Unique MD5 Row Hash Using SQL in BigQuery (Plus a Few Related Things)

Using native BigQuery functionality to generate a dynamic, unique row identifier in SQL — Motivation There are a number of different reasons you might want to build a hash of each row of data in a BigQuery dataset, but they are mostly related to the fact that there is no enforced primary key in BigQuery. This means that your data might contain duplicate rows, whether…

Bigquery

9 min read

How to Build a Unique MD5 Row Hash Using SQL in BigQuery (Plus a Few Related Things)
How to Build a Unique MD5 Row Hash Using SQL in BigQuery (Plus a Few Related Things)
Bigquery

9 min read


Published in Towards Data Science

·May 25, 2022

Getting Started with BigQuery SQL User Defined Functions (SQL UDFs)

A powerful and fundamental building block which enables custom extension of the core BigQuery platform functionality — Motivation Extensibility is one of the key BigQuery characteristics — along with the continuous development of superpower-like new functionalities — which makes it such a powerful platform for any type of data work, big or small. However the feature set of any platform can be overwhelming, and it can be difficult…

Bigquery

5 min read

Getting Started with BigQuery SQL User Defined Functions (SQL UDFs)
Getting Started with BigQuery SQL User Defined Functions (SQL UDFs)
Bigquery

5 min read


Published in Towards Data Science

·Mar 15, 2022

Plotting Bar Charts in BigQuery Using a SQL User Defined Function (UDF)

Minimise context switching and make your workflow faster — There are a number of awesome new tools which aim to bring more interactivity, visualisation, collaboration and sharing to SQL workflows: HEX, Count and Hyperquery are three great examples. But sometimes you just want to focus on working in a basic console, with a few extra features to help accelerate…

Bigquery

9 min read

Plotting Bar Charts in BigQuery Using a SQL User Defined Function (UDF)
Plotting Bar Charts in BigQuery Using a SQL User Defined Function (UDF)
Bigquery

9 min read


Published in Towards Data Science

·Jan 3, 2022

SQL String Templating in BigQuery Scripts: Four Methods

Powerful foundational techniques to help unlock the power of BigQuery scripting and automation — Working with strings in BigQuery became a lot more powerful with the advent of scripting, and specifically the EXECUTE IMMEDIATE statement. This enables you to construct SQL queries as strings and then execute the constructed SQL queries in ad-hoc or scheduled scripts, or inside a callable PROCEDURE or FUNCTION.

Bigquery

7 min read

SQL String Templating in BigQuery: Four Methods
SQL String Templating in BigQuery: Four Methods
Bigquery

7 min read


Published in Towards Data Science

·Nov 10, 2021

Getting Started with BigQuery Scripting

Demystifying this powerful but potentially difficult to grasp aspect of BigQuery functionality, one simple step at a time — Scripting in BigQuery is incredibly powerful but syntactically complicated, especially to anybody who is used to a concise, descriptive, for the most part sequential and human-readable language such as Python. The official documentation on Scripting is a great reference but I have always found it difficult to find a guide…

Bigquery

4 min read

Getting Started with BigQuery Scripting
Getting Started with BigQuery Scripting
Bigquery

4 min read


Published in Dev Genius

·Apr 27, 2021

Connecting BigQuery to Colab and Converting Query Results to Python Dictionaries

A simple method for working with BigQuery results in Python (for pandaphobes) I love Pandas. They’re so cute and cuddly and make great pets. On the other hand, I have to admit that I’m not the biggest fan of the Pandas Python Library… while I do use it (and it…

Bigquery

3 min read

Connecting BigQuery to Colab and Converting Query Results to Python Dictionaries
Connecting BigQuery to Colab and Converting Query Results to Python Dictionaries
Bigquery

3 min read


Published in Towards Data Science

·Apr 22, 2021

Google Cloud Storage (GCS) to BigQuery the simple way

Because simple is better than complex (but complex is better than complicated) — The first Cloud Function I ever deployed was to achieve exactly this task. We had a number of CSV files being dropped into a Google Cloud Storage bucket every night, which needed to be available for transformation and analysis in BigQuery. Spending some time on Google brought me to this…

Bigquery

6 min read

Google Cloud Storage (GCS) to BigQuery the simple way
Google Cloud Storage (GCS) to BigQuery the simple way
Bigquery

6 min read


May 18, 2020

How to explore the history of word usage using Google Books

Analyse the contents of over 25 million books in a matter of seconds When I was at college, finding specific information involved a pretty low-tech and inefficient process. You had to scan through book titles on a standalone computer (from my recollection you could at least search by keywords) to…

3 min read

How to explore the history of word usage using Google Books
How to explore the history of word usage using Google Books

3 min read


May 18, 2020

How to use Google Chrome as a dictionary

Because I don’t carry my Oxford English Dictionary around any more. There are loads of things you probably don’t know about Google Chrome, but this trick is very simple and useful. Step 1: Type `define:` followed by the word you want to look up into the search bar. Step 2…

1 min read

How to use Google Chrome as a dictionary
How to use Google Chrome as a dictionary

1 min read


May 18, 2020

How to take a partial screenshot on a Mac

Because it might be useful for some things. Like writing posts about taking partial screenshots on a Mac. OK that looks easy. In more details: Step 1: Press and hold the command key (⌘) Step 2: While still holding the command key (⌘), press and hold the shift key (⇧) …

2 min read

How to take a partial screenshot on a Mac
How to take a partial screenshot on a Mac

2 min read

Jim Barlow

Jim Barlow

161 Followers

Chief Data Creator @ transformationflow.io

Following
  • Cory Doctorow

    Cory Doctorow

  • Taylor Foreman

    Taylor Foreman

  • Aure's Notes

    Aure's Notes

  • Andrew Zuo

    Andrew Zuo

  • Justin Ng

    Justin Ng

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech