Google BigQuery is part of the Google Cloud Platform of products. It is a fast, economical, and fully managed enterprise data warehouse. There is no infrastructure to manage, so you can focus on analyzing data to find meaningful insights using your favorite data tools.
With our automated data pipeline service, you don't need to worry about configuration, software updates, failures, or scaling your infrastructure as your datasets and number of users grow.
WHY DO I NEED A DATA LAKE OR WAREHOUSE?
To maximize productivity, your data needs to be organized, processed and loaded into a data lake or warehouse. A BigQuery cloud data warehouse will act as a central repository of data aggregated from disparate sources. The data warehouse becomes the hub that allows you to plug in your favorite tools so you can query, discover, visualize or model that data.
WHAT GOOGLE BIGQUERY DATA VISUALIZATION, BUSINESS INTELLIGENCE, REPORTING, OR DASHBOARDING TOOLS CAN I USE?
You have a lot of powerful and affordable choices these days! Tools like Tableau Software, Looker, Mode Analytics, Chartio, and Microsoft Power BI are just a few options to consider. Please take a look at the full list of tools or read our DZone article about creating an objective 10-point business intelligence tool scorecard to help narrow the field. If you have questions, feel free to reach out to us
DO YOU CHARGE FOR DATA LAKE OR WAREHOUSE?
No, there will not be any charges from Openbridge for your warehouse. Any charges are directly billed by the data destination provider (i.e., Google or Amazon) to you.
WHAT ARE THE COSTS?
Every data lake or cloud warehouse has its own pricing model. Often pricing will vary by usage, which is defined by the compute and storage consumed or provisioned. Depending on your situation and requirements, different price-performance considerations may come into play. For example, if you need to start with a no or low-cost solution, Google only charges according to usage. This may provide you with the essentials to kickstart your efforts. If you have questions, feel free to reach out to us. We can offer some tips and best practices on how best to set up a warehouse based on your needs.
IS THERE A GOOGLE CLOUD PLATFORM SDK FOR BIG QUERY?
Yes, Google provides a collection of client libraries in their SDK package. You can download the command-line tools for Google Cloud Platform products and services here. We have also bundled the Google SDK with Docker for a "run anywhere" solution. This includes a set of services that can run export and import operations for BigQuery. Get the pre-built Docker image with Google Cloud SDK.
CAN I USE STANDARD SQL WITH GOOGLE BIGQUERY?
Yes, using standard SQL is supported. Google BigQuery, Amazon Redshift, Amazon Athena, and others support familiar SQL constructs. There may be some limitations or best practices for the specific use case, but the rule of thumb is that SQL is available. Check out our Google BigQuery SQL syntax examples for reference.
HOW IS DATA ENCRYPTED IN BIGQUERY?
BigQuery will encrypt all data at rest and in transit. This is done by default. While there is typically up to a 50% performance penalty for that level of encryption, Google has solved that hurdle so that you won't feel the impact from end-to-end encryption in BigQuery.
WHICH DATA LAKE OR CLOUD WAREHOUSE SHOULD I BE USING?
When it comes to building your data strategy and architecture, it's important to understand which data lake or warehouses should be candidates for consideration. Typically, teams will be asking themselves answers like "How do I install and configure a data warehouse?" or "Which data warehouse solution will help me to get the fastest query times?" or "Which of my analytics tools are supported?"
This article covers key features and benefits of five widely used data lake and warehouse solutions supported by Openbridge to help you choose the right one: How to Choose a Data lake or Warehouse Solution that Fits Your Needs. If you have answers, feel free to reach out to us.
DO I NEED AN EXPERT SERVICES ENGAGEMENT FOR GOOGLE BIGQUERY?
Typically, you will not need services for Google BigQuery. Most customers are up and running using their data quickly. However, if you need support, we do offer data consulting. There may be situations where you have specific needs relating to Google BigQuery. These situations can require expert services to tailor data to fit your requirements.
Ultimately, our mission is to help you get value from data, and this can often happen more quickly with the assistance of our passionate expert services team.
DO I NEED TO AUTHORIZE OPENBRIDGE OR ITS PARTNERS MY ACCESS TO BIGQUERY SYSTEM?
Yes, typically, Google requires authorization to access your data. You would provide us with the service account authorizations, so we can properly connect to their system. The process takes a few minutes to set up in your Openbridge account. You can read about how to set up BigQuery in the Google Cloud console.
HOW IS THE DATA STORED IN BIGQUERY? DO I NEED TO WORRY ABOUT DISK SIZES?
No, there are no disks you need to be concerned about. As your storage needs grow, so does the storage available. BigQuery leverages Capacitor as the native storage format and system. Data will constantly evaluate usage patterns and automatically optimize to improve performance. This is an automated and transparent background process. This means there are no disks to defrag or table vacuums.
DOES BIGQUERY PROVIDE A QUERY CACHE?
Yes, it provides a per-user cache at no charge. If your data doesn't change, the results of your queries will be automatically cached for 24 hours.
IS GOOGLE BIGQUERY FOR DATA ANALYSTS OR DEVELOPERS?
Google can perform equally well for analysts or developers. For example, analyzing data with Tableau is something you can get set up in minutes. Likewise, Google provides a Cloud SDK, which allows a developer to build applications with BigQuery.
IS THERE ANY INFORMATION ON PRODUCTION UPDATES TO BIGQUERY?
Yes, Google Cloud publishes BigQuery release notes.