Dataset
class manages dataset creation and operations. First, define the dataset properties:
add_run_prompt()
adds a new prompt to the dataset.
messages
define how the AI is instructed, with {{value_proposition}}
acting as a placeholder for dataset values.
add_run_prompt()
function.add_evaluation()
attaches an evaluation metric to analyze responses."tone_analysis"
is the evaluation’s name."Tone"
is a preset evaluation template.
input_column_name="summary_prompt"
means it evaluates responses generated by our prompt.save_as_template=True
saves this evaluation for reuse in other experiments.add_optimization()
starts an optimization process."optimized_prompt_1"
assigns a name to the optimized prompt."summary_prompt"
specifies which prompt is being optimized.