Skip to content
@DataSQRL

DataSQRL

Agentic data engineering for operational data

Agentic data engineering for operational data

DataSQRL is an open-source harness for agentic data engineering on operational data. It extends coding agents with a SQL compiler, validator, and event-time simulator. Agents build real-time pipelines, data APIs, and data products on Kafka, Flink, Postgres, Iceberg, Spark, Snowflake, and DuckDB, and the compiler verifies them across every system before deployment. Apache 2.0 licensed, it runs on your infrastructure.

When to use DataSQRL

  • You need a data API (GraphQL, REST, or MCP) over operational data.
  • You build an operational data product with data quality and observability.
  • Kafka is in the pipeline, as source, sink, or both.
  • Results are needed in seconds or minutes, not after the next batch run.
  • An application, a customer, or an AI agent consumes the output, not only a dashboard.
  • You are capturing changes from operational systems into data streams or data lakes.

It is not the fit when the work is dbt models on a schedule inside Snowflake, BigQuery, or Databricks. See how DataSQRL compares.

Get started

Questions and feedback: GitHub Discussions.

Pinned Loading

  1. sqrl sqrl Public

    Agentic data engineering for operational data: real-time pipelines, data APIs, and data products on Kafka, Flink, Postgres, and Iceberg.

    Java 237 32

Repositories

Showing 10 of 16 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…