All Collections
Data Destinations
Data Warehouses
Avoiding Google BigQuery Default Service Expiration Data Loss
Avoiding Google BigQuery Default Service Expiration Data Loss
Openbridge Support avatar
Written by Openbridge Support
Updated over a week ago

Your Google account status may automatically delete data in BigQuery after 60 days. Typically, this is due to being in the Sandbox model or having a billing error or issue.

Google defines an entry-level tier of service for BigQuery:

The BigQuery sandbox gives you free access to the power of BigQuery subject to the sandbox's limits. The sandbox allows you to use the web UI in the Cloud Console without providing a credit card. You can use the sandbox without creating a billing account or enabling billing for your project.

However, the sandbox mode has significant limitations. As such, it is NOT suitable for anything other than exploring the service's features. Openbridge strongly suggests that this mode not be used with our service. If you use or switch to this mode at any point, there is a significant risk of failed data loading and data loss. Why?

Per Google Cloud, if you created or switched to a "sandbox" mode, the limits and quotas can be destructive to your data:

All datasets have the default table expiration time and the default partition expiration set to 60 days. Any tables, views, or partitions in partitioned tables automatically expire after 60 days.

As such, if you started with an account in Sandbox mode or had your account converted to Sandbox mode due to a billing issue, Google will switch everything to a 60-day expiration.

Your data will expire, and Openbridge cannot recover anything Google Cloud deleted from its service. This is a setting in your account and outside of anything Openbridge can control or fix.

Verify and Switch The 60-Day Expiration To Never Expire

You can edit the expiration date in BigQuery. However, you must first ensure you are on a current, active paid billing plan for Google Cloud. To upgrade from the BigQuery sandbox, follow these steps:

Next, make sure table expiration is NOT enabled in your dataset:

Next, you need to review the settings for any tables or views and ensure they are set to be "default table expiration: Never" or "default view expiration: Never"

To edit a table or view expiration, edit and select the expiration to be None.

Restoring Deleted Resources

Per Google, if your tables have expired, you can recover them within 48 hours. If you would like more information, please see Restoring a deleted table. You can also view information about your BigQuery sandbox resources using the audit logs. Audit logs show whether a resource was created using the sandbox and when resources automatically expired.

Did this answer your question?