Data source catalog

Browse the data sources supported by GraphLake v1.1.1 and find the connector, settings, and prerequisites for each one.

On this page

Connect your data

Find the connector below, then follow the connection walkthrough to add it in the console and inspect its tables. The type or storage.provider on each card is the corresponding model YAML setting.

For field types, authentication, and protocol limits, see the connector reference.

Databases

  • PostgreSQL

    Read relational tables and views. Set the DSN environment variable and select a schema.

    type: postgres
  • MySQL

    Connect to a MySQL database with a DSN. Configure TLS and a private CA if needed.

    type: mysql
  • MariaDB

    Read InnoDB tables through the MySQL protocol using a read-only snapshot.

    type: mariadb
  • TiDB

    Connect through the MySQL protocol. Reads are scoped to each remote statement.

    type: tidb
  • OceanBase

    Provide the DSN of an OceanBase tenant running in MySQL mode.

    type: oceanbase
  • SQL Server (direct)

    Connect by TDS using the host, port, database, user, and password environment variable.

    type: sqlserver_native
  • Oracle (direct)

    Use Easy Connect or a TNS name. Install Oracle Instant Client on the GraphLake server.

    type: oracle_native
  • MongoDB (direct)

    Connect using a MongoDB URI. A schema sample identifies mapped fields, including nested fields addressed by dotted names.

    type: mongodb_native
  • SQLite

    Open a database file from the GraphLake server. Use this for lightweight local samples or existing embedded data.

    type: sqlite
  • DuckDB

    Open a server-side DuckDB database file in read-only mode and choose the source schema and table.

    type: duckdb
  • Cloud Spanner

    Specify the database resource path. Reads for tables in the same source can share a read-only transaction.

    type: spanner
  • SAP HANA

    Connect to the tenant SQL port and map table and column names with their exact case.

    type: sap_hana

Warehouses and analytics

  • Snowflake

    Use the SQL API with an API address, token, and compute warehouse. You can specify a Time Travel timestamp.

    type: snowflake
  • BigQuery

    Set the billing project, location, token, and maximum bytes billed per query.

    type: bigquery
  • Databricks SQL

    Provide the workspace URL, token, SQL Warehouse ID, and catalog. Use a view if the mapped data needs scalar columns.

    type: databricks
  • ClickHouse

    Connect to the HTTP interface with an address and user, then map columns from analytical tables.

    type: clickhouse
  • Apache Doris

    Connect with a MySQL-compatible DSN and map analytical tables or views.

    type: doris
  • StarRocks

    Connect to the MySQL-compatible endpoint and map columns in a table or view.

    type: starrocks
  • Trino

    Connect to the coordinator. Reference tables using source.catalog.schema.table.

    type: trino

Files and lakehouse tables

  • Parquet

    Map local files or object URLs to a table. GraphLake reads the schema from Parquet metadata.

    type: parquet
  • CSV

    Map UTF-8, comma-separated files with headers. Declare column names and types in file order.

    type: csv
  • JSON Lines

    Read one JSON object per line. Declare the top-level fields and types the graph will use.

    type: jsonl
  • Apache Iceberg

    Connect to a REST Catalog, select a namespace and table, and optionally pin a snapshot ID.

    type: iceberg
  • Delta Lake

    Map a Delta table’s storage path. Optionally select a table version for reproducible reads.

    type: delta

Object storage

  • Object Storage connector

    Choose a provider and bucket, then map object keys to a Parquet, CSV, or JSON Lines table.

    type: object_storage
  • Amazon S3

    Use a bucket and region with the server’s default identity or named access-key variables.

    storage.provider: s3
  • MinIO

    Provide the MinIO endpoint, bucket, and access-key environment variables.

    storage.provider: minio
  • Alibaba Cloud OSS

    Set the OSS region and endpoint. Use credentials with S3-compatible V4 signing enabled.

    storage.provider: oss
  • Volcengine TOS

    Select the region and use the region’s S3-compatible TOS endpoint.

    storage.provider: tos
  • Tencent Cloud COS

    Set the region and COS endpoint. Include the APPID suffix in the bucket name.

    storage.provider: cos
  • Azure Blob Storage

    Set the storage account and container. Use the default Azure credential chain or an account-key environment variable.

    storage.provider: azure
  • Google Cloud Storage

    Set the bucket and use the default identity or an environment variable containing service-account JSON.

    storage.provider: gcs

Through Trino

  • SQL Server via Trino

    Configure the SQL Server catalog on the Trino coordinator and select it in the GraphLake connector.

    type: sqlserver
  • Oracle via Trino

    Use an Oracle catalog configured in Trino. The coordinator manages the remote database connection.

    type: oracle
  • MongoDB via Trino

    Use the coordinator’s MongoDB catalog and its schema definitions to map collection fields.

    type: mongodb
  • Elasticsearch

    Configure an Elasticsearch catalog in Trino, then select the index and map scalar columns.

    type: elasticsearch
  • Amazon Redshift

    Connect through the Redshift catalog in Trino. Choose the remote schema and table.

    type: redshift
  • Apache Hive

    Choose the Trino connector and reference a table in a configured Hive catalog.

    type: trino
  • Apache Hudi

    Choose the Trino connector and reference a table in a configured Hudi catalog.

    type: trino