Google BigQuery
Learn how to setup an import job using Google BigQuery
Step 1 - Start the Data Upload job
Navigate to the 'Sync Data' page on the left navigation bar in the Future Agi platform and select 'Connectors'. From there, select the 'Big Query' to create a sync job.
Step 2 - Input the Table ID with big query credentials json file.
After successful connection test it will ask for next to update Model Configuration.
Step 3 - Enter model configuration.
Please provide the following details: the model name, the type of model, the environment in which it will be used, and the model version.
Step 4 - Mapping of the field of BigQuery.
To evaluate the model, we need to map essential fields such as conversation_id, timestamp, input, and output to the corresponding columns in your table. Additionally, optional fields like variables(extra information that you using under the templates), context(extra context information), and prompt_template (template using as a prompt) can also be mapped according to your requirements to aid in the evaluation of context and template. This mapping ensures we can retrieve the necessary data accurately.
Step 5 - Mentions the tags.
Additionally, we should mention the tags field for mapping during the model evaluation to ensure comprehensive data retrieval.
Step 6 - Start the job.
Once the final job details are confirmed, we can proceed to start the job.
From there, you will be taken to the 'Job Status' tab where you can see the status of your import jobs.
All active jobs will regularly sync new data from your data source with Future Agi. You can view the job details and import status by clicking on the job ID, which reveals more information about the job.
Step 7 - Pause or Delete An Import Job
To pause or delete your jobs, click on 'Job Status'.
Delete a job if it is no longer needed or if you made an error connecting to the wrong bucket. This will set your job status as 'deleted' in Future Agi.
Pause a job if you have a set cadence to update your table. This way, you can 'start job' when you know there will be new data to reduce query costs. This will set your job status as 'inactive' in Future Agi.
Last updated
