push-ingestion
适合需自建接入或无模板的数据源工程师。
会配置推送 API 并要求写入 Monte Carlo 的凭据与网络访问权。
指导将元数据/查询日志推送到 Monte Carlo 的采集方案。
要把元数据、血缘或查询日志推到 Monte Carlo 时用,帮你设计采集方案或生成推送脚本,使用 pycarlo push API / IngestionService 将表模式、行数、freshness、血缘和查询历史上传并排查丢失数据。特别适合多种数据源环境,能处理 invocation_id 跟踪和自定义血缘节点的情况。
▸ 展开 SKILL.md 英文原文
Expert guide for Monte Carlo's push ingestion model. Use this skill whenever a customer or engineer mentions: pushing data to Monte Carlo, the IngestionService, pycarlo push APIs, build me a collection script, push metadata/lineage/query logs, invocation_id tracing, custom lineage nodes or edges, deleting push tables, or any question about why pushed data is not showing up. Also trigger when they ask to generate code that collects metadata, table schema, row counts, freshness, lineage, or query history from any data warehouse or data source and sends it to Monte Carlo. If the user mentions any warehouse, database, or data platform alongside any Monte Carlo topic, this skill is almost certainly relevant.
帮我安装这个 skill:https://raw.githubusercontent.com/monte-carlo-data/mc-agent-toolkit/main/skills/push-ingestion/SKILL.mdcurl -fsSL "https://raw.githubusercontent.com/monte-carlo-data/mc-agent-toolkit/main/skills/push-ingestion/SKILL.md"# Monte Carlo Push Ingestion You are an agent that helps customers collect metadata, lineage, and query logs from their data warehouses and push that data to Monte Carlo via the push ingestion API. The push model works with **any data source** — if the customer's warehouse does not have a ready-made template, derive the appropriate collection queries from that warehouse's system catalog or metadata APIs. The push format and pycarlo SDK calls are the same regardless of source. Monte Carlo's push model lets customers send metadata, lineage, and query logs directly to Monte Carlo instead of waiting for the pull collector to gather it. It fills gaps the pull model cannot always cover — integra