app.streamkap.com Product Updates logo
Back to Homepage Subscribe to Updates

Product Updates

See the latest features, improvements, and product updates

Labels

  • All Posts
  • Fix
  • Announcement
  • Improvement
  • new

Jump to Month

  • March 2025
  • January 2025
  • November 2024
  • August 2024
  • July 2024
  • May 2024
  • April 2024
  • March 2024
  • February 2024
  • November 2023
  • October 2023
  • September 2023
  • August 2023
  • June 2023
  • May 2023
  • March 2023
  • January 2023
  • December 2022
  • November 2022
  • November 2021
Roadmap
In Planning
Change Event Stream (Thin)
improvement
Connector: HTTP Destination
improvement
Auto Setup Conectors
improvement
Alerts: Schema Changes
improvement
DBT Adapter
improvement
Easy data splitting
improvement
External Sharing with relevant permissions/views
improvement
Suggested Transforms
improvement
Netsuite Source
improvement
Salesforce Source
improvement
S3 Custom Directories and Keyless Support
improvement
Start a pipeline from a given point-in-time
improvement
Billing/Usage Alerts
new
Snowflake (source)
new
Data Selection
improvement
Secrets Store
improvement
Filtering - Remember Choices
improvement
Webhook as a source
improvement
Workspaces
new
Connector: JDBC as a Source
new
Connector: ClickHouse (Source)
new
In Progress
Sorting
improvement
Table/Column Renaming
improvement
S3 Source
improvement
Notifications - OpsGenie, PagerDuty, ServiceNow, Webhook
improvement
Dead Letter Queue (DLQ)
improvement
AWS Private Link (Self Serve)
improvementnew
Destination: Iceberg + 3 Catalog options
new
Alerting - Add datadog, servicenow, opsgenie, pagerduty, webhooks
new
Source: BigQuery
new
Incremental parallel thread snaphots (per topic)
improvementnew
Pub/Sub
new
Connector:Supabase
new
Connector: PlanetScale
new
On-Prem/Bare Metal Deployment
new
Connector: Elastic Search Destination
Connector: Timescale DB
new
Beta
Auto QA - Quality Checks
new
UI support for exclusions
improvement
Surface SMTs
new
Expose Kafka Endpoints (self service)
improvement
Connector: Neon
new
Self Service Transformations Input
improvement
Destination: Redpanda (Write)
new
Destination: Confluent (Write out)
new
Destination: Flink (Pull)
new
Connector: TinyBird
new
Connector: Materialize
new
Source: Redpanda (Pull)
new
Connector: Starburst (pull)
new
Source: Confluent (Pull)
new
Source: Flink (Pull)
new
Connector: Startree
new
PostgreSQL Snapshots without Signal Table
improvement
Connector: GCS Sink
new
BYOK (Bring Your Own Key)
new
Auto Un-Nesting
improvement
Done
Support SSH Tunnels in App
improvement
Metrics API
new
Multiple Environments
improvement
Usage Analysis
improvement
Destination: Azure Blob Storage
new
Destination: Kafka
new
Topics Page
improvement
BYOC - Azure
new
View Transforms Jobs
new
Usage by Topic
new
Conenctor: DuckDB/MotherDuck
new
Snowflake - Upsert Mode
improvement
Pipeline Stats Page
improvement
DynamoDB
new
BYOC AWS
new
New Region Support: East
new
Snowflake - Automate Dynamic Tables
improvement
AWS Ireland
new
Hosted Region Support - Sydney
new
Preview messages
new
Connector: Vitess
new
BYOC - GCP
new
Tags - Apply custom labels
new
new
2 years ago

Adhoc Snapshot Support 🚀

We're thrilled to announce that we've added support for adhoc snapshotting, enabling you to capture snapshots at the connector and table levels effortlessly.

Key Features of Adhoc Snapshotting:

  • Connector-Level: Trigger snapshots at the connector level to run a comprehensive snapshot across all tables ensuring a complete and up-to-date snapshot.
  • Table-Level: Snapshot specific tables on-demand.
  • Cancel Option: Easily cancel a snapshot in progress.
  • Speed Setting: Change the speed at which adhoc snapshots are carried out. 

More information on how our snapshots work is available here

If you have any questions or need further assistance, our dedicated support team is ready to help you make the most of this feature.

Snapshot Docs

Avatar of authorRicky Thomas
new
2 years ago

Error Handling

Previously, when setting up a connector, editing or adjusting settings, we would show a generic placeholder but now we will show the actual error.

  • Example screenshot below showing a MongoDB connection string error. 
  • In the not too distant future we will be improving the error messages to be more helpful as well as adding improved field validation.

Avatar of authorRicky Thomas
new
2 years ago

📢 Visibility & Troubleshooting with the New Logs Page 🚀

We're pleased to announce the beta release of our new logs page, which provides insight into your pipelines performance.

Beta version

  • Comprehensive Log Data: Access raw log data for INFO, WARN, and ERROR messages across all established connectors.
  • Easy Access: Access the logs page conveniently via the sidebar or via each connector, where it will pre-filter.

Within 1 week from now

  • Filtering: Drop-down filters for connectors and log levels. 
  • Stack Traces: Dive deeper into any logged event with detailed stack traces. Quickly identify the root cause of an issue and accelerate your troubleshooting process.

We would love to hear any feedback and suggestions to further improve


Docs

Avatar of authorRicky Thomas
new
2 years ago

SOC2 Update + New Trust Center 🏆

We know how important security is to our customer and so we are excited to announce another two updates!

SOC2

Streamkap has achieved SOC2 Type 1 compliance and our 3 month observation window ends in the next couple of weeks. We expect to formally have SOC2 Type 2 by mid June and will update you on this as we receive it. 

Trust Center 

We have a real-time continuous monitoring platform to ensure we remain SOC2 compliant at all times. In full transparency, we are now sharing this with you at https://trust.streamkap.com. Please get in touch if you would like a copy of any reports for your security team. 

Trust Center

Avatar of authorRicky Thomas
Improvement
2 years ago

Pipeline Create/Edit Improvements

Create and edit pipelines has been updated to use the same schema tree structure you experience when creating and editing the source schema. 

This will make it easier to work with with multiple schemas from a single source compared to before. Example screenshot below


Avatar of authorRicky Thomas
Improvement
2 years ago

Security Updates

Streamkap continues to take the security of your data seriously. We've added the following

  • Additional notifications: We've added in additional email notifications to keep your account secure for 2FA/MFA devices being enrolled or disabled. 
  • Password breach alert: We detect whether your password has been involved in a breach outside of Streamkap by monitoring external databases for breaches against email addresses and comparing the hashes.
  • IP address and domain restrictions:  Our customers can now lock down access to IP addresses or domains such as your company domain

Please do remember it is possible to force 2FA/MFA org wide also as well as setup SSO.

Let us know if you need any help with any of these settings.

View Docs
Avatar of authorRicky Thomas
new
2 years ago

Edit Mode, Bulk Schema Update and New Settings 🚀

Are you ready to take control of Streamkap? We're excited to announce some much-requested new features for better control and visibility for your sources, destinations and snapshotting.  

Within your sources and destination detail pages you will find you can now Edit and there are new tabs:

Auth: Edit connection details

Schema: Edit your schema. We've introduced a new tree structure here as well as a bulk CSV upload

Settings: Choose options such as:

  • Snapshot/Backfill mode. Incremental snapshots can be the default approach of backfilling new tables and streaming at the same time. Update on this coming out shortly in more detail.
  • Chunk and Batch size to choose the speed at which data is consumed

Let us know if you need any assistance leveraging these new features.

Avatar of authorRicky Thomas
Improvement
2 years ago

PostgreSQL snapshotting is now faster

Historically, Streamkap's snapphotting queries have been generic across our sources. 

We now use specific SQL suitable for PostgreSQL, which improves performance in loading historical data

Avatar of authorRicky Thomas
Improvement
2 years ago

Security enhancements

The following security enhancements have been added

  • Ability to remember 2FA/MFA devices for 30 days
  • 2FA/MFA methods supported now also include: Security keys, SMS and built in authenticators (i.e. fingerprint, face recognition) as well as auth apps
  • Password repeat protection
  • Exposed credential detection - email notification/error message
  • Password strength meter
  • Passwordless expiration time changed to 20 min
  • Force Relogin changed to 90 days
  • Maximum Concurrent Sessions 10
  • Idle Session Timeout changed to 1 day
  • 2FA/MFA custom name defaults to Streamkap

Avatar of authorRicky Thomas
new
2 years ago

Starburst Destination for CDC (Change Data Capture)

Starburst destination is now supported for change data capture (CDC).

Features

  • Real-time data ingestion
  • Schema evolution support
  • Parquet and Iceberg format
Setup Docs
Avatar of authorRicky Thomas