BigQuery is a serverless, budget-friendly, multicloud data warehouse created to assist you in transforming large data into insightful business information.
BigQuery supports several ways to load data:
- Stream API: This allows you to insert data into BigQuery in real-time.
- Batch API: You can upload data into BigQuery using a batch API in the form of JSON, Avro, Parquet, ORC or CSV.
- File uploads: You can upload data into BigQuery using the web UI, command-line tool, or API.
- Cloud Storage: You can transfer data directly from Cloud Storage into BigQuery.
- Cloud Datastore Backup: You can load data from Google Cloud Datastore Backup into BigQuery.
- Cloud Pub/Sub: You can load data into BigQuery by publishing messages to a Cloud Pub/Sub topic.
- External Data Sources: You can load data from external data sources like Google Drive, Google Sheets or Google Cloud SQL into BigQuery.
The best method for loading data into BigQuery depends on the volume, velocity and structure of the data, as well as the requirements for real-time processing.
BigQuery import urls to refer
