Providers & Connections

Conduit ships with a typed provider system: every connector implements a category trait (SqlProvider, StorageProvider, HttpProvider, StreamProvider, SaasProvider, DocumentProvider) on top of the base Provider trait. Configure connections in conduit.yaml and validate them with conduit test-connection <name>.

32 provider types: 12 production, 20 experimental. Experimental providers expose the trait interface but their operations return NotImplemented; conduit compile warns when a DAG routes through one. This table is generated from each provider's ProviderInfo.is_stub flag โ€” it cannot drift from the code.

Status legend
โœ… ProductionReal implementation with a live test_connection
๐Ÿงช ExperimentalTrait interface only; operations return NotImplemented

SQL Databases

StatusProviderType IDAliases
โœ…Google BigQuerybigquerybq
๐ŸงชClickHouseclickhousech
โœ…CockroachDBcockroachdbcrdb
โœ…DuckDBduckdbduck
โœ…MySQLmysqlmariadb
๐ŸงชOracle Databaseoracleโ€”
โœ…PostgreSQLpostgrespostgresql, pg
โœ…Amazon Redshiftredshiftโ€”
โœ…Snowflakesnowflakesf
โœ…SQLitesqliteโ€”
๐ŸงชSQL Serversqlservermssql
โœ…TimescaleDBtimescaledbtsdb

Object Storage

StatusProviderType IDAliases
โœ…Google Cloud Storagegcsgoogle_cloud_storage
โœ…Amazon S3s3aws_s3

HTTP / Webhooks

StatusProviderType IDAliases
โœ…HTTP/REST APIhttphttps, rest, webhook

Streaming

StatusProviderType IDAliases
๐ŸงชApache Kafkakafkaโ€”
๐ŸงชAWS Kinesiskinesisโ€”
๐ŸงชGCP Pub/Subpubsubgcp_pubsub
๐ŸงชRabbitMQrabbitmqamqp
๐ŸงชRedis Streamsredisredis_stream

SaaS Platforms

StatusProviderType IDAliases
๐ŸงชGitHubgithubgh
๐ŸงชHubSpothubspotโ€”
๐ŸงชJirajiraโ€”
๐ŸงชSalesforcesalesforcesfdc
๐ŸงชSlackslackโ€”
๐ŸงชStripestripeโ€”

Document / NoSQL

StatusProviderType IDAliases
๐ŸงชCassandracassandrascylladb
๐ŸงชDynamoDBdynamodbโ€”
๐ŸงชElasticsearchelasticsearchopensearch, es
๐ŸงชMongoDBmongodbmongo
๐ŸงชNeo4jneo4jโ€”
๐ŸงชRedis KVredis_kvโ€”

Configuration

Connections live under connections: in conduit.yaml. Secrets can be injected from environment variables or a secrets backend rather than committed inline. Example:

connections:
  warehouse:
    type: postgres
    host: db.internal
    port: 5432
    database: analytics
    # credentials resolved from CONDUIT_CONN_WAREHOUSE or a secrets backend

Validate connectivity before running pipelines:

conduit test-connection warehouse