feat: Search created by user in pipeline run API

[yuechao-qin]

TL;DR

Implemented search created_by user in Pipeline Runs.

What changed?

Functionality

• API GET /api/pipeline_runs/

  • Search created_by user in filter_query. Example query (not URL encoded for example):

    /api?filter_query={"and": [{"value_equals": {"key": "system/pipeline_run.created_by", "value": "alice@example.com"}}]}

  • Annotation value me is supported for created_by search.

• API POST /api/pipeline_runs/

  • Copies the created_by data to the annotations table for future searching. Example pipeline run annotations table after API is called:

    pipeline_run_id	key	value
    abc123	system/pipeline_run.created_by	alice@example.com

• API [PUT|DELETE] /api/pipeline_runs/{id}/annotations/{key}

  • Prevent (create, update, delete) of annotations with system/ prefix. Reserved for system annotation usage.

Other

• Database migration: Added backfill logic to populate existing pipeline runs with created_by annotations. Example what a pipeline run's created by user would look like in the annotations table:

pipeline_run_id	key	value
42	system/pipeline_run.created_by	alice@example.com

How to test?

uv run pytest tests/test_api_server_sql.py  tests/test_filter_query_sql.py tests/test_database_ops.py

1. Create pipeline runs with different created_by values
2. Use filter queries like {"and": [{"value_equals": {"key": "system/pipeline_run.created_by", "value": "alice"}}]} to search by creator
3. Test the "me" placeholder: {"and": [{"value_equals": {"key": "system/pipeline_run.created_by", "value": "me"}}]}
4. Verify that attempts to set/delete system annotations return 422 errors
5. Test that unsupported predicates on system keys (like value_contains) are rejected

Why make this change?

• This enables users to search for pipeline runs by creator using the new filter query system.
• Following safety guards and synchronization will allow old and new data (create_by) to be searchable with the new filter.
  • Preventing (create, delete, update) system prefix in annotations
  • Saving created_by to annotations table when starting a Pipeline Run

[yuechao-qin]

• feat: Add include_sql to Search Pipeline Run API #135
• feat: API Server - Pipeline Runs - Changed the pagination token to a cursor #131
• feat: Search within date range in pipeline run API #130
• feat: Search pipeline name in pipeline run API #129
• refactor: Convert legacy filter to be filter_query #128
• feat: Search created by user in pipeline run API #108 👈 (View in Graphite)
• feat: Search annotations in pipeline run API #107
• feat: Create Pydantic models for Search Pipeline Run API #106
• refactor: Search pipeline run refactoring and baseline unit tests #105
• master

This stack of pull requests is managed by Graphite. Learn more about stacking.

[Volv-G]

looks good to me

[Ark-kun]

Approved with comment.

[yuechao-qin]

Merge activity

• Mar 6, 8:42 PM UTC: A user started a stack merge that includes this pull request via Graphite.
• Mar 6, 8:47 PM UTC: Graphite rebased this pull request as part of a merge.
• Mar 6, 8:48 PM UTC: @yuechao-qin merged this pull request with Graphite.