12 months ago
New Destination Connector: CockroachDB
With Streamkap, you can now stream real-time data into CockroachDB.
CockroachDB is a popular high performant distributed database.
Roadmap
In Review
Change Event Stream (Thin)
improvement
Auto Setup Conectors
improvement
Easy data splitting
improvement
Salesforce Source
improvement
Netsuite Source
improvement
DBT Adapter
improvement
External Sharing with relevant permissions/views
improvement
In Planning
Connector: HTTP Destination
improvement
Alerts: Schema Changes
improvement
Suggested Transforms
improvement
S3 Custom Directories and Keyless Support
improvement
Start a pipeline from a given point-in-time
improvement
Billing/Usage Alerts
new
AWS Private Link (Self Serve)
improvementnew
Snowflake (source)
new
Data Selection
improvement
Secrets Store
improvement
Filtering - Remember Choices
improvement
Webhook as a source
improvement
Workspaces
new
Connector: JDBC as a Source
new
Connector: ClickHouse (Source)
new
In Progress
Sorting
improvement
Table/Column Renaming
improvement
S3 Source
improvement
Notifications - OpsGenie, PagerDuty, ServiceNow, Webhook
improvement
Dead Letter Queue (DLQ)
improvement
Self Service Transformations Input
improvement
Destination: Iceberg + 3 Catalogs
new
Alerting - Add datadog, servicenow, opsgenie, pagerduty, webhooks
new
Pub/Sub
new
Source: BigQuery
new
Incremental parallel thread snaphots (per topic)
improvementnew
Connector:Supabase
new
Connector: PlanetScale
new
On-Prem/Bare Metal Deployment
new
Conenctor: DuckDB/MotherDuck
new
Connector: Materialize
new
Connector: Startree
new
Connector: Starburst (pull)
new
Connector: TinyBird
new
Beta
Auto QA - Quality Checks
new
UI support for exclusions
improvement
Surface SMTs
new
Expose Kafka Endpoints (self service)
improvement
Connector: Neon
new
Done
Support SSH Tunnels in App
improvement
Multiple Environments
improvement
Usage Analysis
improvement
Destination: Azure Blob Storage
new
Destination: Kafka
new
Topics Page
improvement
BYOC - Azure
new
View Transforms Jobs
new
Usage by Topic
new
Snowflake - Upsert Mode
improvement
Pipeline Stats Page
improvement
DynamoDB
new
BYOC AWS
new
New Region Support: East
new
Snowflake - Automate Dynamic Tables
improvement
AWS Ireland
new
Hosted Region Support - Sydney
new
Preview messages
new
Connector: Vitess
new
BYOC - GCP
new
a year ago
Clone Connectors
The highly requested feature to clone connectors is now available. It is accessible by using the Clone option from the connector menu.
Using Clone will open the create connector page but with all the fields and schema already filled in, except for the password field.
a year ago
Sub-Accounts for Enterprise Org Management
It is now possible to create sub-accounts within an organization, sub-accounts are entities in their own rights isolated from each other. Multiple sub-accounts can be created within an organization and can be further nested to create sub-sub-accounts.
Sub-accounts can be billed individually or can be rolled up to the parent account. The parent account subscription in that case can cover all the sub-accounts too and receive volume discounts.
a year ago
New Roles
Additional roles have been made available. Coupled with Groups, there is now more flexibility on how to control access.
The following roles are currently supported:
- Admin - Full access to everything
- Data Admin - Can create/edit sources/destinations/pipelines but does not have admin access
- Read Only - Read only access to everything
- Sub Accounts - Can create/edit sub accounts
- Team Management - Can add/edit users- Billing - Access to subscription page only
Please let us know if there are other roles/permissions you would like access to
a year ago
Streamkap Terraform Provider
Streamkap recently announced our API and we've now leveraged this to create the HashiCorp Terraform provider for Streamkap.
With this provider, you can now manage Streamkap through Terraform.
Available from the HashiCorp Registry
a year ago
Stream CDC data into DB2
Today we are announcing support for streaming real-time data to DB2
The following features are supported:
- At-least-once delivery
- Delete mode (Delete entries or leave them with metadata updated indicating it has been deleted at source)
- Idempotent writes (Insert/Upsert mode)
- Schema evolution
DB2 is now available under Destinations to add today.
a year ago
Stream CDC data into MySQL
Today we are announcing support for streaming real-time data to MySQL.
The following features are supported:
- At-least-once delivery
- Delete mode (Delete entries or leave them with metadata updated indicating it has been deleted at source)
- Idempotent writes (Insert/Upsert mode)
- Schema evolution
MySQL is now available under Destinations to add today.
Start Streaming CDC to MySQLa year ago
Stream CDC data into Oracle
Today we are announcing support for streaming real-time data to PostgreSQL.
The following features are supported:
- At-least-once delivery
- Delete mode (Delete entries or leave them with metadata updated indicating it has been deleted at source)
- Idempotent writes (Insert/Upsert mode)
- Schema evolution
PostgreSQL is now available under Destinations to add today.
a year ago
Stream CDC data into PostgreSQL
Today we are announcing support for streaming real-time data to PostgreSQL.
The following features are supported:
- At-least-once delivery
- Delete mode (Delete entries or leave them with metadata updated indicating it has been deleted at source)
- Idempotent writes (Insert/Upsert mode)
- Schema evolution
PostgreSQL is now available under Destinations to add today.
a year ago
Stream CDC data into SQL Server
Today we are announcing support for streaming real-time data to SQL Server.
The following features are supported:
- At-least-once delivery
- Delete mode (Delete entries or leave them with metadata updated indicating it has been deleted at source)
- Idempotent writes (Insert/Upsert mode)
- Schema evolution
SQL Server is now available under Destinations to add today.