Jobs
Jobs are asynchronous operations that sync content from sources into Ground’s index.Job Lifecycle
Job Stages
Each job progresses through stages:| Stage | Description | Progress |
|---|---|---|
queued | Waiting in Redis queue | 0% |
fetch | Downloading content | 10% |
parse | Extracting text | 25% |
chunk | Splitting into chunks | 40% |
embed | Generating embeddings | 60% |
index | Storing in database | 80% |
finalize | Updating metadata | 95% |
Job Metrics
Jobs track:files_processed: Number of files/pages processedchunks_created: New chunks addedchunks_updated: Existing chunks modifiedchunks_deleted: Old chunks removed
API Operations
Get Job Status
List Jobs
Cancel Job
Error Handling
Failed jobs include:error_message: Human-readable error descriptionerror_details: Structured error information
retry_count: Current retry attemptmax_retries: Maximum retries (default: 3)
Idempotency
Jobs are designed to be idempotent and resumable:- Content hashes prevent duplicate processing
- Incremental updates only modify changed chunks
- Worker can restart at any stage checkpoint