Create Linear issues from Arize AX evaluation regressions
Send evaluation regressions into Linear with the failure context your team needs to investigate.
Trigger
Webhook received
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Action
Create linear issue
Creates a new issue in a specified linear project and team, requiring a title and description, and allowing for optional properties like assignee, state, priority, cycle, and due date.
Why this helps
Evaluation regressions can get buried in dashboards, leaving teams to manually reconstruct what failed and why.
- Move actionable evaluation failures into the engineering queue.
- Preserve the evaluation context available in the request.
- Reduce manual copying between Arize AX and Linear.
Setup
Build it in a few focused steps.
- 1Connect Arize AX and Linear once in the Notis portal.
- 2Create an automation in Automations, New Automation, and name it.
- 3Describe that actionable evaluation regressions should become Linear issues with available failure context.
- 4Choose the webhook trigger and select where run reports should go.
- 5Test with one real evaluation regression.
Questions about this workflow
Does Arize AX provide a trigger event for this workflow?
No. The workflow uses a Notis webhook, which starts when an HTTP request reaches its webhook endpoint.
What information will the Linear issue include?
Notis can include information available in the webhook request, such as the evaluation result and failure details. Supply any required context that the request does not contain.
When this happens · Trigger
Do this · Action
Supported Triggers and Actions
Notis builds workflows that link Arize AX to Linear. A trigger fires from one place; an action lands in another.
Arize AX triggers
Linear actions
Recurring trigger
Notis starts this workflow on a schedule, such as daily, weekly, or during business hours.
Create linear attachment
Creates a new attachment and associates it with a specific, existing linear issue.
Webhook trigger
Notis starts this workflow when an external tool or custom backend sends an HTTP request.
Create a comment
Creates a new comment on a specified linear issue.
Create linear issue
Creates a new issue in a specified linear project and team, requiring a title and description, and allowing for optional properties like assignee, state, priority, cycle, and due date.
Get create issue default params
Fetches a linear team's default issue estimate and state, useful for pre-filling new issue forms.
Create a label
Creates a new label in linear for a specified team, used to categorize and organize issues.
Delete issue
Archives an existing linear issue by its id, which is linear's standard way of deleting issues; the operation is idempotent.
Get all teams
Retrieves all teams from the linear workspace without requiring any parameters.
Download issue attachments
Downloads a specific attachment from a linear issue; the `file name` must include the correct file extension.
Connect any two apps with Notis in the middle.
Arize AX and Linear, or any other combination from 1,000+ integrations.
When this happens · Trigger
Do this · Action
Save your first hour today.
7-day trial of any paid plan, with 20$ of usage included.
No card. Works with personal or business Linear.