Skip to main content
Version: 16.4

Integration

PAT Token​

  • Login with admin user,
  • Go to [Setting],
  • Generate PAT with name,
  • Copy PAT token.

Collection​

API for import raw data, trigger pipeline​

headers["authorization"] = "pat " + token
event_data = {
    'code': 'event_code',       # raw topic name
    'data': {                   # raw topic data
        # ...data
    },
    'triggerType': 'insert'     # always be insert for raw data
}

response = requests.post(
    'http://localhost:8000/pipeline/data', data=json.dumps(event_data), headers=headers)
return response.json()
tip

Or use /pipeline/data/async, it returns once data saved and trigger pipelines processing asynchronously.

Via Other Middleware​

Kafka​

Send raw data to topic (KAFKA_TOPICS)

{
    "code": "a_topic",
    "data": {
        // ...
    },
    "triggerType": "insert-or-merge",
    "tenantId": "1",
    "traceId": "1",
    "pat": "..."
}

Visit here for description of properties. And for Kafka, one more property pat is required.

Rabbit Mq​

Send raw data to queue with exchange.

{
    "code": "a_topic",
    "data": {
        // ...
    },
    "triggerType": "insert-or-merge",
    "tenantId": "1",
    "traceId": "1",
    "pat": "..."
}

Visit here for description of properties. And for RabbitMQ, one more property pat is required.

Third Party BI​

info

Connect BI to Trino (If it is enabled) or storage directly.

And use Starburst ODBC driver,