Add Data Using SDK
An ideal for automating data ingestion, managing large datasets, and integrating with external workflows.
By adding data using the SDK, you can:
- Create new datasets programmatically.
- Add structured data efficiently.
- Automate dataset updates.
- Seamlessly integrate with Future AGI’s data processing pipeline.
1. Accessing the SDK Integration Panel
To add data using the SDK:
- Go to the “Datasets & Experiments” Section
- Navigate to the Datasets page from the main dashboard.
- Click on the “Add Dataset” button.
- Select “Add Data Using SDK”
-
A pop-up will appear with various dataset creation methods.
-
Choose “Add Data Using SDK” to proceed.
-
2. Creating a Dataset
- Enter a Dataset Name
- A prompt appears asking for the dataset name.
- Enter a clear, descriptive name
- Click “Next” to proceed.
- Review Dataset Creation Settings
-
The interface confirms the dataset setup before proceeding.
-
Click “Next” to generate the SDK integration code.
-
3. Generating SDK Integration Code
- View Pre-Generated Code
- The system generates ready-to-use SDK code in multiple languages:
- Python
- TypeScript
- cURL
- The code includes:
- API key authentication.
- Dataset creation command.
- Methods for adding data.
- The system generates ready-to-use SDK code in multiple languages:
- Copy the Code
-
Select the preferred language.
-
Copy the snippet for use in your application.
-
4. Adding Data to the Dataset
- Use the SDK Code to Add Data
- Paste the copied SDK code into your development environment.
- Replace any placeholder values if necessary.
- Execute the script to send data to the dataset.
- Confirm Data Upload
-
After execution, the dataset will be populated with the provided data.
-
The dataset will appear in the Datasets & Experiments list.
-
5. Viewing the Dataset
- Navigate to the Dataset List
- The newly created dataset is now visible in the Datasets panel.
- Displays dataset details such as:
- Name
- Type (e.g., Generative)
- Number of data points
- Associated experiments and evaluations
- Verify Data Entries
-
Click on the dataset name to inspect the added rows.
-
Check for correct formatting and structure.
-
Using the SDK, you can efficiently create and manage datasets in Future AGI. This method provides a scalable way to ingest, update, and automate data handling, making it suitable for AI-driven workflows and large-scale applications.