Creates, manages, and queries Arize datasets and examples. Covers dataset CRUD, appending examples, exporting data, and file-based dataset creation using the ax CLI. Use when the user needs test data, evaluation examples, or mentions create dataset, list datasets, export dataset, append examples, da

Arize Dataset Skill SPACE — space flags accept a space name (e.g., my workspace ) or a base64 space ID (e.g., U3BhY2U6... ). Find yours with ax spaces list . Concepts Dataset = a versioned collection of examples used for evaluation and experimentation Dataset Version = a snapshot of a dataset at a point in time; updates can be in place or create a new version Example = a single record in a dataset with arbitrary user defined fields (e.g., question , answer , context ) Space = an organizational container; datasets belong to a space System managed fields on examples ( id , created at , updated at ) are auto generated by the server never include them in create or append payloads. Prerequisites Proceed directly with the task — run the ax command you need. Do NOT check versions, env vars, or profiles upfront. If an ax command fails, troubleshoot based on the error: command not found or version error → see [references/ax setup.md](references/ax setup.md) 401 Unauthorized / missing API key → run ax profiles show to inspect the current profile. If the profile is missing or the API key is wrong, follow [references/ax profiles.md](references/ax profiles.md) to create/update it. If the user doesn't have their key, direct them to https://app.arize.com/admin API Keys Space unknown → see [Space](references/ax profiles.md space) Project unclear → ask the user, or run ax projects list o json limit 100 and present as selectable options Security: Never read .env files or search the filesystem for credentials. Exception: the non secret ARIZE SPACE ID line (see [Space](references/ax profiles.md space)). Use ax profiles for Arize credentials and ax ai integrations for LLM provider keys. Never ask the user to paste secrets into chat. For missing credentials, see [references/ax profiles.md](references/ax profiles.md). List Datasets: ax datasets list Browse datasets in a space. Listing is for human browsing; when the dataset name or ID is known, call ax datasets get NAME OR ID space SPACE o json directly. For all flags, run ax datasets list help . Get Dataset: ax datasets get Quick metadata lookup returns dataset name, space, timestamps, and version list. For all flags, run ax datasets get help . Response fields Field Type Description id string Dataset ID name string Dataset name space id string Space this dataset belongs to created at datetime When the dataset was created updated at datetime Last modification time versions array List of dataset versions (id, name, dataset id, created at, updated at) Export Dataset: ax datasets export Download examples to a file. By default, export returns one page of examples ( limit sets the page size, cursor selects a later page). Pass all to export the full dataset. Use filter for server side narrowing with a SQL like expression over example columns, id , and annotation.<name . ; filter is not supported with all . For all flags, run ax datasets export help . Agent rule: Pass all whenever the task needs every example; an export without all stops after one page. Export completeness verification: After exporting, confirm the row count matches what the server reports: Output is a JSON array of example objects. Each example has system fields ( id , created at , updated at ) plus all user defined fields: Create Dataset: ax datasets create Create a new dataset from a data file ( file ) or inline JSON ( json ). For all flags, run ax datasets create help . Passing data via stdin Use file to pipe data from another command: Supported file formats Format Extension Notes CSV .csv Column headers become field names JSON .json Array of objects JSON Lines .jsonl One object per line (NOT a JSON array) Parquet .parquet Column names become field names; preserves types Format gotchas: CSV : Loses type information — dates become strings, null becomes empty string. Use JSON/Parquet to preserve types. JSONL : Each line is a separate JSON object. A JSON array ( [{...}, {...}] ) in a .jsonl file will fail — use .json extension instead. Parquet : Preserves column types. Requires pandas / pyarrow to read locally: pd.read parquet("examples.parquet") . Append Examples: ax datasets append Add examples to an existing dataset. Two input modes use whichever fits. Inline JSON (agent friendly) Generate the payload directly no temp files needed: From a file To a specific version For all flags, run ax datasets append help . Exactly one of json or file is required. Validation Each example must be a JSON object with at least one user defined field Maximum 100,000 examples per request Schema validation before append: If the dataset already has examples, inspect its schema before appending to avoid silent field mismatches: Fields are free form: extra fields in new examples are added, and missing fields become null. However, typos in field names (e.g., queston vs question ) create new columns silently verify spelling before appending. Update Examples: ax datasets update examples ax datasets update examples patches rows by example id ; ax datasets delete examples removes rows from one version and requires version id plus example ids as a JSON array of example IDs. Uncommon — run ax datasets update examples help or ax datasets delete examples help for flags and input formats. Delete Dataset: ax datasets delete For all flags, run ax datasets delete help . Update Dataset: ax datasets update Rename an existing dataset. For all flags, run ax datasets update help . Annotate Examples: ax datasets annotate examples Write annotations onto dataset examples in bulk from a file. Upsert semantics — existing annotations with the same key are updated, new ones are created. Up to 1000 examples per request. Each record needs a record id (the dataset example ID) and values ; unmatched record IDs are silently ignored, so confirm IDs against an export first. For all flags, run ax datasets annotate examples help . Workflows Find a dataset by name All dataset commands accept a name or ID directly (add space SPACE when passing a name). To resolve a name to its ID, read it from get : Create a dataset from file for evaluation 1. Prepare a CSV/JSON/Parquet file with your evaluation columns (e.g., input , expected output ) If generating data inline, pass it with json or pipe it via file (see the Create Dataset section) 2. ax datasets create name "eval set v1" space SPACE file eval data.csv 3. Verify: ax datasets get DATASET NAME space SPACE 4. Use the dataset name to run experiments Add examples to an existing dataset Download dataset for offline analysis 1. ax datasets export DATASET NAME space SPACE all download every example to file 2. Parse the JSON: jq '.[] .question' dataset /examples.json Export a specific version Iterate on a dataset 1. Export current version: ax datasets export DATASET NAME space SPACE all 2. Modify the examples locally 3. Append new rows: ax datasets append DATASET NAME space SPACE file new rows.csv 4. Or create a fresh version: ax datasets create name "eval set v2" space SPACE file updated data.json Pipe export to other tools Dataset Example Schema Examples are free form JSON objects. There is no fixed schema columns are whatever fields you provide. System managed fields are added by the server: Field Type Managed by Notes id string server Auto generated UUID. Required on update, forbidden on create/append created at datetime server Immutable creation timestamp updated at datetime server Auto updated on modification (any user field) any JSON type user String, number, boolean, null, nested object, array Related Skills arize trace : Export production spans to understand what data to put in datasets → use arize trace arize experiment : Run evaluations against this dataset → next step is arize experiment arize prompt optimization : Use dataset + experiment results to improve prompts → use arize prompt optimization Troubleshooting Problem Solution ax: command not found See [references/ax setup.md](references/ax setup.md) 401 Unauthorized API key is wrong, expired, or doesn't have access to this space. Fix the profile using [references/ax profiles.md](references/ax profiles.md). No profile found No profile is configured. See [references/ax profiles.md](references/ax profiles.md) to create one. Dataset not found Check the name or ID with ax datasets get NAME OR ID space SPACE ; use ax datasets list space SPACE only to browse for the right name File format error Supported: CSV, JSON, JSONL, Parquet. Use file to read from stdin. platform managed column Remove id , created at , updated at from create/append payloads reserved column Remove time , count , or any source record field Provide either json or file Append requires exactly one input source Examples array is empty Ensure your JSON array or file contains at least one example not a JSON object Each element in the json array must be a {...} object, not a string or number Save Credentials for Future Use See [references/ax profiles.md](references/ax profiles.md) § Save Credentials for Future Use.

arize-dataset