Building Feature Stores with Redis Enterprise on Google Cloud

Every day, more and more companies are building feature stores for machine learning (ML) with Redis and Redis Enterprise as the online feature store. In previous blog posts, we shared use cases and benchmarks illustrating how Redis Enterprise is the most performant and cost-effective online feature store for high throughput, low latency, or real-time use cases. 

We also shared tutorials on running Redis with the popular open source feature store Feast, locally, on Google Colab, and Azure—including with enterprise-grade Redis, thanks to the Enterprise Tiers of Azure Cache for Redis. In addition, we explained why Redis OSS or AWS Elasticache is often not enough and why companies that are outgrowing their OSS or ElastiCache implementations are upgrading to Redis Enterprise on AWS.  


In this blog post, we focus on why leading companies, such as Feast co-creator Gojek, are migrating to Redis Enterprise on Google Cloud. We also share a quickstart tutorial on how to run Redis Enterprise with Feast on Google Cloud Platform (GCP).

diagram displaying feature store with google colab using redis enterprise

Redis Enterprise as the online feature store on Google Cloud Platform

If you are already familiar with GCP, then Redis Enterprise on Google Cloud may be your best option. It’s not only the most performant database for online feature stores on GCP (see, for example, benchmarks performed by Feast that compare Google Cloud Datastore to Redis), but it also provides you a fully managed option for your online feature store, allowing for simple management and scaling of Redis Cluster—a major benefit of Redis Enterprise over Redis OSS. In addition to the high performance and ease of management, Redis Enterprise on Google Cloud provides linear scalability and five-nines (99.999% SLA) availability, ensuring the online feature store is cost-effective at scale and experiences no downtime.

Gojek upgrades its online feature store to Redis Enterprise

For these reasons, leading companies such as Indonesian ride-hailing service Gojek have upgraded from Redis OSS to Redis Enterprise on Google Cloud. Since then, Gojek has expanded into numerous new countries, transforming into a “super app” that provides more than 20 services, including an e-wallet service, food delivery, courier service, and more. It has become one of the most successful and fastest-growing technology companies, valued at more than $10B, with its ML platform powering many of its use cases.  

Gojek is also the co-creator (together with Google Cloud) of open source feature store Feast, which it launched in January 2019 using Redis OSS for its online feature store. 

Feast is part of the Linux Foundation’s AI & Data Foundation. Feast can serve features from a low-latency online store or an offline store while also providing a central registry, storage, and serving. This allows ML engineers and data scientists to discover the relevant features for ML use cases and serve them in production. 

Today Feast has become the most popular open source feature store. It is deployed together with Redis as its online store in leading companies such as online mortgage company Better.com, American FinServ company Robinhood, Indian B2B wholesale retailer platform Udaan, digital consulting company Publicis Sapient, and many more—including, of course, Gojek itself. (For more details on Feast and its components, check out this Feast with Redis overview, as well as the Feast documentation on Feast.dev.) 

Since the launch of Feast, Gojek and its feature store have grown substantially in terms of scale and the number of use cases, to the point where the company has outgrown its Redis OSS implementation and moved to Redis Enterprise on Google Cloud instead. Gojek can now enjoy all the goodness of Redis OSS together with the benefits of Redis Enterprise: a fully managed cluster, five-nines availability, linear scalability, and other Redis Enterprise features such as Redis modules and enterprise-grade security.

Getting started with Redis Enterprise on Google Cloud with Feast

Now for a short overview of the quickstart tutorial on running Redis Enterprise on Google Cloud with open source Feast. Detailed explanations are available inside the tutorial itself on Google Colab

The tutorial provides a step-by-step guide that walks you through using Feast with Redis Enterprise as its online feature store for ML on GCP. It’s based on the Feast Quickstart tutorial, but instead of using the default online store, it uses Redis Enterprise as its online store to deliver real-time predictions at scale. If you’re unfamiliar with Feast or Redis Enterprise on Google Cloud, then the fastest way to get started is by taking this helpful tutorial.

In this tutorial, you will:

  1. Deploy a feature store Google Colab with a Parquet file offline store and Redis Enterprise on Google Cloud as its online store.
  2. Build a training dataset using the demo time series features from the Parquet files.
  3. Materialize (load) feature values from the offline store into the Redis Enterprise online store.
  4. Read the latest features from the Redis Enterprise online store for inference.

You can run the tutorial on Google Colab by following the steps described in the Colab notebook.

Prerequisite for running the tutorial

To run this tutorial, you will need a Redis Enterprise database instance from Google Cloud Marketplace. If you do not have an existing Redis Enterprise subscription through Google Cloud Marketplace, you can claim your FREE Google Cloud Marketplace $400 credit.

Tutorial scenario and steps

In this tutorial, we use feature stores to generate training data and power online model inference for a ride-sharing driver satisfaction prediction model. In the demo data scenario, we surveyed some drivers to determine how satisfied they are with their experience using a ride-sharing app. The goal is to generate predictions for driver satisfaction for the rest of the users so we can reach out to potentially dissatisfied users.

Tutorial steps:

  1. Install Feast and verify your Redis Enterprise database in Google Cloud Marketplace.
  2. Create a feature repository and configure Redis as the online store.
  3. Register feature definitions and deploy your feature store. 
  4. Generate training data.
  5. Load features into your Redis online store.
  6. Fetch feature vectors for inference from Redis online store.

What’s next?

In this blog post and accompanying Colab tutorial, we introduced you to Redis Enterprise as an online feature store on Google Cloud. We provided a quick introduction to the popular open source feature store Feast, as well as a step-by-step tutorial on how to set up Redis Enterprise on Google Cloud as the online store for Feast. To learn more about Redis Enterprise, check out the resource section of Redis.com for additional blog posts, ebooks, webinars, and more.

Go experience the speed and scalability of Redis Enterprise as the online feature store for your Feast deployment!