Skip to content

fix(integrations): close follow-ups from the integration validation audits - #10183

Merged
waleedlatif1 merged 7 commits into
stagingfrom
fix/validate-sweep3-followups
Nov 18, 2026
Merged

waleedlatif1 merged 7 commits into
stagingfrom
fix/validate-sweep3-followups

Conversation

@waleedlatif1

@waleedlatif1 waleedlatif1 commented Nov 18, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Closes follow-ups that independent audits found in the already-merged integration validation PRs (#10164-#10181), plus two items the audits flagged as broken in production: Kalshi Create/Cancel/Amend Order and Greptile Query/Search. Each fix is small and stays backward compatible. No block type, subBlock, operation, tool, param or output id was renamed or removed, and no OAuth scope was added. Saved workflows send the same request as before, except where the old request was a bug (listed below). Every behavior fix has a test, and each test was checked to fail on the pre-fix code.

# Fix Found by
1, 12-14 Pinecone Search Text: namespace is required (the block already required it, and the URL cannot be built without it), the param type is no longer widened, rerank.rank_fields is required again as in the 2025-01 spec, and one shared rerank-query helper Pinecone audit (#10164 final audit)
2 Pinecone Fetch: a plain single ID typed on the canvas (vec-1) is fetched instead of failing "ids must be valid JSON". JSON arrays still work Pinecone audit
3 Vercel Create Project: a nodeVersion outside Vercel's documented enum is rejected before the project is created, so no stray project is left behind Vercel audit
4 Exa Get Contents / Find Similar Links: an untouched text, highlights, subpages or excludeSourceDomain is no longer sent as null / 0. An explicit false / 0 is still sent Exa audit (#10178/#10179)
5 Tavily error extractor: a plain-text or HTML error body is capped at 500 characters Tavily audit
6 Lemlist: the Get Activities lead filter no longer overwrites Send Email's Lead ID. The mapping moves from tools.config.tool (serialization) into tools.config.params, scoped to Get Activities, and keeps the agent's leadId arg Lemlist audit
7 Polymarket Get Positions: redeemable / mergeable filters an agent sends as JSON booleans now apply Polymarket audit (#10181)
8, 34 Spotify check tools: the first /contains chunk gets the same array check as later chunks, through one shared helper Spotify audit (#10175/#10177)
9 Kalshi Create, Cancel and Amend Order (v1 and v2 tools) move to Kalshi's V2 event-order API. Kalshi removed the old /portfolio/orders write endpoints (410 deprecated_v1_order_endpoint) Kalshi audit
10 Greptile: Query is hidden from the operation dropdown and from the agent tool operation picker (which now skips any hidden operation, as it already skipped permission-denied ones) (kept as a hidden option so saved workflows and v2 state writes stay valid), and the Query/Search tools are marked retired Greptile audit
11 Elasticsearch: date-math index names like <logs-{now/d}> work again (encoded as Elasticsearch documents), and dot segments are still rejected. This was a regression against main #10164 final audit
15 safeUrlPathSegment TSDoc @returns updated #10164 final audit
16, 17 One blockFieldOrToolArg helper replaces the copies in SQS and SSM (codepipeline keeps its own, whose null/'' semantics differ). The stale-input test now asserts the executor merge #10165/#10168 final audit
18 AppSheet test now exercises find_rows transformResponse with a bare-array body #10165/#10168 final audit
20-22 Fathom: one deleteFathomWebhook helper for both delete paths; typed test context instead of as never; Ashby test comment trimmed #10166/#10167 final audit
23-26 Cursor toRecord; Ketch vendors description; 1Password UNSUPPORTED vault type typed from the SDK enum; Infisical approval fields marked nullable #10170/#10171 final audit
27-30 PostHog Create Feature Flag fails clearly on a rollout it cannot apply; two restating PostHog tests removed; DSPy reuses parseOptionalJsonInput (keeping its static error message, which never quotes the input); Gamma test renamed #10173/#10174 final audit
31-33, 38 Spotify Follow/Unfollow Artists and Follow Playlist go back to main's exact requests; dead album chunk calls removed; Limit placeholder notes the Development Mode cap #10175/#10177 final audit
35-37 Lemlist Interested / Not Interested activity types; Wealthbox Write Task's unreachable update branch removed; four Wealthbox tests that could not fail removed #10175/#10177 final audit
39-42 Polymarket cursor input, raw activity start/end, placeholders; SFTP connector reuses the shared joinRemotePath (same output for its normalized paths) #10181 final audit
43-46 arXiv block outputs list query / authorName; Parallel logs "completed" only after the failed/cancelled check; Linkup cost lookup table (same prices); Quiver retired-model Set #10178/#10179 final audit

Left for a product decision:

  • Greptile has no documented replacement for /v2/query and /v2/search. Index Repository and Check Status are unchanged.

Release notes

Pinecone

  • Fetch accepts a single plain vector ID (for example vec-1) as well as a JSON array.
  • Search Text now tells agents the namespace is required. A search without one already failed.

Vercel

  • Create Project rejects an unsupported Node.js version (for example 22 instead of 22.x) before creating the project. Before, the project was created and then the version update failed, leaving an extra project behind. A blank version still means no version.

Exa

  • Get Contents and Find Similar Links no longer send content options you never set. A never-touched Subpages field used to send 0, and untouched switches sent null.

Tavily

  • Plain-text or HTML error pages (for example from a proxy) are shortened to 500 characters in the error message.

Lemlist

  • Send Email uses its own Lead ID even when a Get Activities lead filter is still saved on the block. Get Activities no longer filters by a Lead ID left over from Send Email.
  • Get Activities with type Interested or Not Interested (now labeled Email Interested / Email Not Interested) works. It used to fail with a 400. Saved values are unchanged.

Polymarket

  • Get Positions applies redeemable / mergeable filters sent by an agent as true/false values.
  • Get Activity passes Start / End through unchanged, so 0 means the full history and a value that is not a timestamp gets a clear error.
  • The Size Threshold placeholder now shows the real default (0.1 shares). The Username placeholder notes that Polymarket no longer supports filtering by username.

Spotify

  • Check tools report a clear error when Spotify returns an unexpected response, instead of a cryptic one.
  • Follow Artists, Unfollow Artists and Follow Playlist send exactly the requests they sent before the recent library migration.
  • The Limit placeholder notes that Development Mode apps allow at most 10.

Kalshi

Create Order, Cancel Order and Amend Order work again. Kalshi removed the old /portfolio/orders write endpoints, so they now use /portfolio/events/orders. Saved blocks keep their fields; this is how they translate, per Kalshi's OpenAPI spec:

  • Direction and price. Kalshi's new API quotes every order on the YES book. Buy Yes at a yes price p becomes a bid at p, and Sell Yes an ask at p. Buy No at a no price q becomes an ask at 1 - q, and Sell No a bid at 1 - q. The order trades exactly as before. Prices are sent as fixed-point dollars (56 cents = 0.5600), and contracts as a fixed-point count. Setting both a yes and a no price that disagree is an error.
  • Time in force. A saved Time in Force is kept. When it is blank, the order is sent as good_till_canceled. Without an expiration that rests until canceled, which is what the old API did. Expiration is sent as expiration_time.
  • Self-trade prevention. Kalshi now requires it. A new optional advanced field, Self-Trade Prevention, has "Taker at cross (default)" first and "Maker" second. Left unset, orders use taker_at_cross, the value in Kalshi's own request example.
  • Unchanged pass-through. Post Only, Reduce Only, Cancel on Pause, Client Order ID, Order Group and Subaccount are sent as before.
  • Clear errors instead of a different trade. A Market order fails and asks for a limit order with a price; Kalshi removed market orders on 2026-02-11, and Market stays only as a hidden option so saved blocks still load. Max Cost fails and asks for a limit price with Time in Force fill_or_kill, because Kalshi has no replacement field.
  • Amend. Contracts is the order's new total (filled plus resting), which is what both the old and new amend APIs mean. If Contracts or the price is left empty, the order is read first and its current total or YES price is sent. A price-only or count-only amend therefore keeps working.
  • Outputs. Every output key is kept, including every key of the old v1 order object (as null when Kalshi no longer reports it). Kalshi now returns only the order ID, client order ID and fill counts from a create, cancel or amend. The order output reports those, plus the direction, price and settings that were sent; fields Kalshi no longer reports are null. A count-less or price-less amend also reports the order as it was before the amend in old_order. The V2 amend order output gains yes_price_dollars, no_price_dollars, fill_count_fp and remaining_count_fp.
  • Cancel. Kalshi routes a cancel to the order's exchange shard by market_ticker. Without it the cancel goes to shard 0, and an order on another shard (Combos, Crypto and Commodities, Sports) answers 404 and stays open. Cancel Order therefore has a new optional Market Ticker field, sent as market_ticker. When it is empty, the order is read first to find its ticker. Set Market Ticker when cancelling an order you just created; without it, Sim reads the order first, and Kalshi's order reads can briefly lag after a write. The canceled count is unchanged, and order carries order_id, client_order_id and ticker.
  • Read-first safety. If a cancel or amend fails after the order read, the step reports the failure. A successful read is never reported as a successful cancel or amend. Order reads can briefly lag a change, so leave Contracts empty on an amend only when the order hasn't just changed.

Greptile

  • The Query operation is no longer offered, because Greptile removed the endpoint. Saved Query blocks still load, but the call fails. New blocks start on Index Repository.

Agent tool picker

  • Hidden (retired) operations no longer appear in the Agent tool operation picker: Greptile Query, Kalshi Get Exchange Announcements and Linear Create Cycle. Agent tools already saved on them keep working.

Elasticsearch

  • Date-math index names such as <logs-{now/d}> work again.

PostHog

  • Create Feature Flag now fails with a clear message when Rollout Percentage is set but Filters has no groups array. Before, the rollout was silently dropped.

Wealthbox

  • Write Task is described as "Create a Wealthbox task", which is what it does.

Ketch, 1Password, Infisical, arXiv

  • Output descriptions corrected: Ketch vendors is the deprecated list of opted-out vendor IDs; 1Password vault type can be UNSUPPORTED; Infisical approval IDs and timestamps can be null; arXiv lists the query and authorName outputs.

@vercel

vercel Bot commented Nov 18, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
docs Ready Ready Preview Nov 18, 2026 10:11pm UTC

Request Review

@greptile-apps

greptile-apps Bot commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerView in GreptileConfidence Score: 5/5

[Critical impact] The PR appears safe to merge; no new blocking issues were found.

Summary

This PR updates integration requests, tightens input checks, and keeps retired operations out of new selections while preserving saved workflows.

  • Kalshi order tools send create, amend, and cancel requests through its V2 order API.
  • Greptile Query stays in saved workflows but disappears from new operation choices.
  • Pinecone accepts plain fetch IDs and requires a namespace for text searches.
  • Exa leaves content options out until someone sets them.
  • Tavily error messages cap plain-text and HTML response bodies.
  • Spotify library checks validate every response chunk, and follow tools send their expected requests.
  • Lemlist activity filters no longer replace the Send Email lead ID.
  • Polymarket position filters accept boolean values from agents.
  • Vercel rejects unsupported Node.js versions before creating a project.
  • PostHog Create Feature Flag rejects rollouts it cannot apply.
  • Elasticsearch requests accept date-math index names without allowing dot segments.
  • SQS and SSM blocks share the same fallback for blank block fields.
  • Fathom webhook cleanup uses one shared delete path.
  • Wealthbox Write Task creates tasks instead of routing to an update path.
  • 1Password vault results include the SDK’s unsupported vault type.
  • Infisical approval output fields can be null.
  • Arxiv blocks expose the query and author name in their outputs.
  • Ketch describes vendors as opted-out vendor IDs.
  • Cursor artifact mapping safely handles entries that are not objects.
  • Linkup search costs come from a named depth and output table.
  • Parallel logs completion only after checking the task result.
  • The SFTP connector reuses the shared remote-path join helper.
  • DSPy Additional Inputs use the shared optional JSON parser.
  • Small documentation and test edits clarify existing integration behavior.

As documented by waleedlatif1, saved Greptile Query calls still fail because the endpoint was retired; a replacement remains a product decision. No new actionable issues were found.

Diagram

sequenceDiagram
    participant W as Workflow or agent
    participant T as Kalshi tool
    participant K as Kalshi API
    W->>T: Create, cancel, or amend order
    opt Cancel lacks ticker or amend lacks count or price
        T->>K: Read current order
        K-->>T: Current order fields
    end
    T->>K: Write through event-order endpoint
    K-->>T: Write result
    T-->>W: Order outputs or failure
Loading

Reviews (7) · Last reviewed commit: "fix(integrations): keep every legacy kal..." · Reviewed by Greptile

Comment thread apps/sim/tools/spotify/library.test.ts Resolved
@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed against the latest diff

Reply with feedback, questions, or to request a fix.

Turn on auto-fix | Re-trigger cubic

Comment thread apps/sim/tools/kalshi/cancel_order.ts Resolved
Comment thread apps/sim/tools/pinecone/fetch.ts Resolved
Comment thread apps/sim/tools/error-extractors.ts Resolved
Comment thread apps/sim/blocks/blocks/greptile.ts Resolved
Comment thread apps/sim/blocks/blocks/spotify.ts Resolved
@cubic-dev-ai

cubic-dev-ai Bot commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 86 files

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

Turn on auto-fix | Re-trigger cubic

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai

cubic-dev-ai Bot commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai

cubic-dev-ai Bot commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 94 files

Reply with feedback, questions, or to request a fix.

Turn on auto-fix | Re-trigger cubic

Comment thread apps/sim/tools/kalshi/create_order.ts Resolved
Comment thread apps/sim/tools/kalshi/amend_order.ts Resolved
@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai

cubic-dev-ai Bot commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 93 files

You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Turn on auto-fix | Re-trigger cubic

Comment thread apps/sim/tools/kalshi/orders.ts Resolved
@waleedlatif1
waleedlatif1 force-pushed the fix/validate-sweep3-followups branch from ec87f50 to 29a2ac6 Compare November 18, 2026 22:06
@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai

cubic-dev-ai Bot commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 93 files

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Turn on auto-fix | Re-trigger cubic

@waleedlatif1
waleedlatif1 merged commit bc48d10 into staging Nov 18, 2026
64 of 65 checks passed
@waleedlatif1
waleedlatif1 deleted the fix/validate-sweep3-followups branch November 18, 2026 22:12
@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@greptile

@waleedlatif1

Copy link
Copy Markdown
Collaborator Author

@cubic-dev-ai review this PR

@cubic-dev-ai

cubic-dev-ai Bot commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 93 files

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Re-trigger cubic

This branch was successfully deployed

1 active deployment
Preview — 29a2ac68 Deployed Nov 18, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant