3 days ago
Connector: MotherDuck/DuckDB Destination
We've added support for MotherDuck, the commercial version of DuckDB.
Check out our MotherDuck docs or get in touch to learn more
Roadmap
In Review
Change Event Stream (Thin)
improvement
Auto Setup Conectors
improvement
Easy data splitting
improvement
Salesforce Source
improvement
Netsuite Source
improvement
DBT Adapter
improvement
External Sharing with relevant permissions/views
improvement
In Planning
Connector: HTTP Destination
improvement
Alerts: Schema Changes
improvement
Suggested Transforms
improvement
S3 Custom Directories and Keyless Support
improvement
Start a pipeline from a given point-in-time
improvement
Billing/Usage Alerts
new
Snowflake (source)
new
Data Selection
improvement
Secrets Store
improvement
Filtering - Remember Choices
improvement
Webhook as a source
improvement
Workspaces
new
Connector: JDBC as a Source
new
Connector: ClickHouse (Source)
new
In Progress
Sorting
improvement
Table/Column Renaming
improvement
S3 Source
improvement
Notifications - OpsGenie, PagerDuty, ServiceNow, Webhook
improvement
Dead Letter Queue (DLQ)
improvement
Self Service Transformations Input
improvement
AWS Private Link (Self Serve)
improvementnew
Destination: Iceberg + 3 Catalogs
new
Alerting - Add datadog, servicenow, opsgenie, pagerduty, webhooks
new
Source: BigQuery
new
Incremental parallel thread snaphots (per topic)
improvementnew
Pub/Sub
new
Connector:Supabase
new
Connector: PlanetScale
new
On-Prem/Bare Metal Deployment
new
Connector: Elastic Search Destination
Connector: GCS Sink
new
Beta
Auto QA - Quality Checks
new
UI support for exclusions
improvement
Surface SMTs
new
Expose Kafka Endpoints (self service)
improvement
Connector: Neon
new
Destination: Redpanda (Write)
new
Destination: Confluent (Write out)
new
Destination: Flink (Pull)
new
Connector: TinyBird
new
Connector: Materialize
new
Source: Redpanda (Pull)
new
Connector: Starburst (pull)
new
Source: Confluent (Pull)
new
Source: Flink (Pull)
new
Connector: Startree
new
Done
Support SSH Tunnels in App
improvement
Multiple Environments
improvement
Usage Analysis
improvement
Destination: Azure Blob Storage
new
Destination: Kafka
new
Topics Page
improvement
BYOC - Azure
new
View Transforms Jobs
new
Usage by Topic
new
Conenctor: DuckDB/MotherDuck
new
Snowflake - Upsert Mode
improvement
Pipeline Stats Page
improvement
DynamoDB
new
BYOC AWS
new
New Region Support: East
new
Snowflake - Automate Dynamic Tables
improvement
AWS Ireland
new
Hosted Region Support - Sydney
new
Preview messages
new
Connector: Vitess
new
BYOC - GCP
new
2 months ago
Bring Your Own Cloud (BYOC) - Now Available on AWS, Azure & GCP 🚀
Bring Your Own Cloud (BYOC) is a new Streamkap deployment whereby we run the data plane within your VPC.
Today we announce support across all major cloud providers including AWS, Azure and GCP providing our customers a choice of deployment options.
BYOC is good for use cases such as:
- Data must be kept within your own environment to meet your organisational security standards
- Working with substantial volumes of data to reduce egress costs
- A zero maintenance managed Kafka/Flink deployment option
- 99.99 SLA with Streamkap support
Take a look at our Bring Your Own Cloud (BYOC) Docs to learn more
2 months ago
SaaS hosted - Now supporting Region AWS Europe Ireland
Today, we've added support for another region in AWS Europe Ireland (eu-west-1).
Get in touch if you would like to migrate workloads
5 months ago
New AWS Region Support - us-east-1 (Virginia)
We're excited to announce support for AWS us-east-1 (Virginia).
We are looking at existing customers to deem whether they would be better off migrating to this region but if you would like to move across, please get in touch.
More regions are coming soon
5 months ago
DynamoDB - New Source
Announcing support for AWS DynamoDB
Amazon DynamoDB is a fully managed, serverless, key-value NoSQL database that runs high-performance applications at any scale, with built-in security, ...
5 months ago
Db2 - New Source
Added support for IBM Db2 database as a source.
IBM Db2 is a family of data management products, including RDBMS, for efficient data storage, retrieval, and analytics. It supports multiple platforms, including mainframes (z/OS) and distributed systems (LUW: Linux, UNIX, Windows).
8 months ago
Migration from Passwords to Magic Links
We have updated our login options to improve security. The changes are as follows
Removed: Password login
Added: Magic Link. Magic link is a unique link that will be emailed to you and expires after 20 minutes.
Therefore, if you currently login via username/password, the change in behavior will be that upon entering your email address, you will be emailed a link to login that will expire after 20 minutes. If you miss the 20min, you will need to request another magic link.
We've done this to further strengthen and lock down our security posure to protect your data. As a reminder, we support other passkeys and other SSO options including Google, Microsoft, Slack, Github and enterprise SSO. You can also enforce 2FA at any time.
9 months ago
Dashboard
Dashboard operational page is now available within the app 🚀
- Updates in real-time to the second
- Status of pipelines and transforms
- Overall trend/usage
- 10 Metrics for analysis over 1 day, 7 days, 30 days, 90 days, 365 days
Get started by visiting Dashboard
9 months ago
SSH Tunnels Self Setup
It's now possible to setup SSH tunnels in the app without liaising with support
When creating or editing a source, you will now see a toggle option to connect via SSH where you will br provided the key and the ability to input your jump host details.
In future, we will be adding support for tunnels on destinations as well as sources.
