#AmazonKinesisStreams hashtag - Bluesky - nopzon.com

Bluesky Explorer

#

Hashtag

#AmazonKinesisStreams

AWS News(Unofficial)

@awsnews.bsky.social

4 months ago

Amazon Kinesis Data Streams now supports up to 50 enhanced fan-out consumers Amazon Kinesis Data Streams now supports 50 enhanced fan-out consumers for On-demand Advantage streams. A higher fan-out limit lets customers attach many more independent, low-latency, high-throughput consumers to the same stream—unlocking parallel analytics, ML pipelines, compliance workflows, and multi-team architectures without creating extra streams or causing throughput contention. On-demand Advantage is an account-level setting that unlocks more capabilities and provides a different pricing structure for all on-demand streams in an AWS Region. On-demand Advantage offers data usage with 60% lower pricing compared to On-demand Standard, with data ingest at $0.032/GB, data retrieval at $0.016/GB, and enhanced fan-out data retrieval at $0.016/GB. High fan-out workloads are most cost effective with On-demand Advantage. Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale. Enhanced fan-out is an Amazon Kinesis Data Streams feature that enables consumers to receive records from a data stream with dedicated throughput of up to 2 MB of data per second per shard, and this throughput automatically scales with the number of shards in a stream. A consumer that uses enhanced fan-out doesn't have to contend with other consumers that are receiving data from the stream. For accounts with On-demand Advantage enabled, you can continue to use the existing Kinesis API RegisterStreamConsumer to register new consumers to use enhanced fan-out up to the new 50 limit. Support for enhanced fan-out consumers is available in the AWS Regions listed https://docs.aws.amazon.com/streams/latest/dev/enhanced-consumers.html. For more information on Kinesis Data Streams quotas and limits, please see our https://docs.aws.amazon.com/streams/latest/dev/service-sizes-and-limits.html. For more information on On-demand Advantage, please see our https://docs.aws.amazon.com/streams/latest/dev/how-do-i-size-a-stream.html#diff-modes-kds for On-demand Advantage.

Amazon Kinesis Data Streams now supports up to 50 enhanced fan-out consumers

Amazon Kinesis Data Streams now supports 50 enhanced fan-out consumers for On-demand Advantage streams. A higher fan-out limit lets customers attach many more ...

#AWS #AmazonKinesis #AwsGovcloudUs #AmazonKinesisStreams

1 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

4 months ago

Amazon Kinesis Data Streams now supports up to 50 enhanced fan-out consumers Amazon Kinesis Data Streams now supports 50 enhanced fan-out consumers for On-demand Advantage streams. A higher fan-out limit lets customers attach many more independent, low-latency, high-throughput consumers to the same stream—unlocking parallel analytics, ML pipelines, compliance workflows, and multi-team architectures without creating extra streams or causing throughput contention. On-demand Advantage is an account-level setting that unlocks more capabilities and provides a different pricing structure for all on-demand streams in an AWS Region. On-demand Advantage offers data usage with 60% lower pricing compared to On-demand Standard, with data ingest at $0.032/GB, data retrieval at $0.016/GB, and enhanced fan-out data retrieval at $0.016/GB. High fan-out workloads are most cost effective with On-demand Advantage. Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale. Enhanced fan-out is an Amazon Kinesis Data Streams feature that enables consumers to receive records from a data stream with dedicated throughput of up to 2 MB of data per second per shard, and this throughput automatically scales with the number of shards in a stream. A consumer that uses enhanced fan-out doesn't have to contend with other consumers that are receiving data from the stream. For accounts with On-demand Advantage enabled, you can continue to use the existing Kinesis API RegisterStreamConsumer to register new consumers to use enhanced fan-out up to the new 50 limit. Support for enhanced fan-out consumers is available in the AWS Regions listed here. For more information on Kinesis Data Streams quotas and limits, please see our documentation. For more information on On-demand Advantage, please see our documentation for On-demand Advantage.

🆕 Amazon Kinesis now supports 50 enhanced fan-out consumers for parallel analytics and ML pipelines. On-demand Advantage cuts data usage costs by 60%. Available in select regions.

#AWS #AmazonKinesis #AwsGovcloudUs #AmazonKinesisStreams

1 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

4 months ago

AWS Glue Schema Registry adds support for C# https://docs.aws.amazon.com/glue/latest/dg/schema-registry.html (GSR) has now expanded the programming language support for GSR Client library to include C# support along with existing Java support. C# applications integrating with Apache Kafka or https://aws.amazon.com/msk/, https://aws.amazon.com/kinesis/data-streams/, and Apache Flink or https://aws.amazon.com/managed-service-apache-flink/ can now interact with AWS Glue Schema Registry to maintain data quality and schema compatibility in streaming data applications. AWS Glue Schema Registry, a serverless feature of https://aws.amazon.com/glue/, enables you to validate and control the evolution of streaming data using registered schemas at no additional charge. Schemas define the structure and format of data records produced by applications. Using AWS Glue Schema Registry, you can centrally manage and enforce schema definitions across your data ecosystem. This ensures consistency of schemas across applications and enables seamless data integration between producers and consumers. Through centralized schema validation, teams can maintain data quality standards and evolve their schemas in a controlled manner. C# support is available across all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where Glue Schema Registry is available. Visit the Glue Schema Registry https://docs.aws.amazon.com/glue/latest/dg/schema-registry-gs-serde-csharp.html , and https://www.nuget.org/packages/AWS.Glue.SchemaRegistry to get started with C# integration.

AWS Glue Schema Registry adds support for C#

docs.aws.amazon.com/glue/latest/dg/schema-re... now expanded the programming language support for GSR Client library to...

#AWS #AmazonMsk #AmazonManagedServiceForApacheFlink #AwsGovcloudUs #AwsGlue #AmazonKinesisStreams

1 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

4 months ago

AWS Glue Schema Registry adds support for C# AWS Glue Schema Registry (GSR) has now expanded the programming language support for GSR Client library to include C# support along with existing Java support. C# applications integrating with Apache Kafka or Amazon Managed Streaming for Apache Kafka (Amazon MSK), Amazon Kinesis Data Streams, and Apache Flink or Amazon Managed Service for Apache Flink can now interact with AWS Glue Schema Registry to maintain data quality and schema compatibility in streaming data applications. AWS Glue Schema Registry, a serverless feature of AWS Glue, enables you to validate and control the evolution of streaming data using registered schemas at no additional charge. Schemas define the structure and format of data records produced by applications. Using AWS Glue Schema Registry, you can centrally manage and enforce schema definitions across your data ecosystem. This ensures consistency of schemas across applications and enables seamless data integration between producers and consumers. Through centralized schema validation, teams can maintain data quality standards and evolve their schemas in a controlled manner. C# support is available across all AWS regions where Glue Schema Registry is available. Visit the Glue Schema Registry developer guide, and SDK to get started with C# integration.

🆕 AWS Glue Schema Registry now supports C#, adding it to Kafka, MSK, Kinesis, and Flink. This expands client library to C#, ensuring data quality and schema compatibility in all regions.

#AWS #AmazonMsk #AmazonManagedServiceForApacheFlink #AwsGovcloudUs #AwsGlue #AmazonKinesisStreams

1 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

4 months ago

Amazon Kinesis Data Streams launches On-demand Advantage mode Amazon Kinesis Data Streams launches On-demand Advantage, so customers can warm on-demand streams to handle instant throughput increases up to 10GB or 10 million events per second, eliminating the need to over-provision or build custom scaling solutions. Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale. On-demand streams automatically scale capacity based on data usage, and now you can warm write capacity ad hoc. On-demand Advantage also provides a simpler pricing structure that removes the fixed, per-stream charge, so customers only pay for data usage at better rates. On-demand Advantage offers data usage with 60% lower pricing compared to On-demand Standard, with data ingest at $0.032/GB and data retrieval at $0.016/GB in the US East (N. Virginia) region. The price of Enhanced fan-out data retrieval is the same as shared-throughput retrievals, making higher fan-out use cases more cost effective. The mode also decreases the price of extended retention by 77% from $0.10/GB-month to $0.023/GB-month. Once you enable On-demand Advantage mode, the account will be billed for a minimum of 25MB/s of data ingest and 25MB/s of data retrieval at the lower rates across all on-demand streams. The new pricing means On-demand Advantage is the most cost effective way to stream with Kinesis Data Streams when you ingest at least 10MB/s in aggregate, fan out to more than two consumer applications, or have hundreds of streams in a region. You can check directly in the https://console.aws.amazon.com/kinesis/home# and the https://aws.amazon.com/kinesis/data-streams/pricing/ if On-demand Advantage is a good fit for your account. On-demand Advantage is available in all AWS regions where Kinesis Data Streams is available, including AWS GovCloud (US) and China regions. To learn more, see the https://aws.amazon.com/blogs/big-data/amazon-kinesis-data-streams-launches-on-demand-advantage-for-instant-throughput-increases-and-streaming-at-scale/ and the https://docs.aws.amazon.com/streams/latest/dev/working-with-streams.html.

Amazon Kinesis Data Streams launches On-demand Advantage mode

Amazon Kinesis Data Streams launches On-demand Advantage, so customers can warm on-demand streams to handle instant throughput increases up to 10GB or 10 million events per s...

#AWS #AwsGovcloudUs #AmazonKinesis #AmazonKinesisStreams

0 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

4 months ago

Amazon Kinesis Data Streams launches On-demand Advantage mode Amazon Kinesis Data Streams launches On-demand Advantage, so customers can warm on-demand streams to handle instant throughput increases up to 10GB or 10 million events per second, eliminating the need to over-provision or build custom scaling solutions. Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale. On-demand streams automatically scale capacity based on data usage, and now you can warm write capacity ad hoc. On-demand Advantage also provides a simpler pricing structure that removes the fixed, per-stream charge, so customers only pay for data usage at better rates. On-demand Advantage offers data usage with 60% lower pricing compared to On-demand Standard, with data ingest at $0.032/GB and data retrieval at $0.016/GB in the US East (N. Virginia) region. The price of Enhanced fan-out data retrieval is the same as shared-throughput retrievals, making higher fan-out use cases more cost effective. The mode also decreases the price of extended retention by 77% from $0.10/GB-month to $0.023/GB-month. Once you enable On-demand Advantage mode, the account will be billed for a minimum of 25MB/s of data ingest and 25MB/s of data retrieval at the lower rates across all on-demand streams. The new pricing means On-demand Advantage is the most cost effective way to stream with Kinesis Data Streams when you ingest at least 10MB/s in aggregate, fan out to more than two consumer applications, or have hundreds of streams in a region. You can check directly in the Kinesis console and the pricing page if On-demand Advantage is a good fit for your account. On-demand Advantage is available in all AWS regions where Kinesis Data Streams is available, including AWS GovCloud (US) and China regions. To learn more, see the launch blog and the Kinesis Data Streams User Guide.

🆕 Amazon Kinesis Data Streams' On-demand Advantage scales up to 10GB/s, cuts costs by 60%, and offers $0.032/GB ingest and $0.016/GB retrieval in US East (N. Virginia), with no fixed charges. Available worldwide.

#AWS #AwsGovcloudUs #AmazonKinesis #AmazonKinesisStreams

2 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

5 months ago

Amazon Kinesis Data Streams now supports 10x larger record sizes Amazon Kinesis Data Streams now supports record sizes up to 10MiB, a tenfold increase from the previous 1MiB limit. This launch enables customers to publish intermittent larger data payloads in their data streams while continuing to use existing Kinesis Data Streams APIs in their applications. This launch is accompanied by a 2x increase in the maximum PutRecords request size from 5MiB to 10MiB. Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store real-time data streams at any scale. With this launch, customers no longer need to maintain separate processing pipelines for handling intermittent large records, and can thus simplify their data pipelines. This reduces operational overhead for IoT analytics, change data capture, and generative AI workloads. You can update your stream's maximum record size up to 10 MiB using either the AWS Management Console or the UpdateMaxRecordSize API via the AWS SDK or CLI. Once your stream is configured, you can publish and consume larger records using existing Kinesis Data Streams APIs. You do not incur additional costs to use this capability beyond your regular Kinesis data streams charges. In conjunction with this launch, AWS Lambda now supports larger payloads up to 6MiB from Kinesis Data Streams. Amazon Kinesis Data Streams supports large records in the AWS Regions documented https://docs.aws.amazon.com/streams/latest/dev/large-records.html. To learn more about using large records and how common downstream applications handle large records, please see our https://docs.aws.amazon.com/streams/latest/dev/large-records.html.

Amazon Kinesis Data Streams now supports 10x larger record sizes

Amazon Kinesis Data Streams now supports record sizes up to 10MiB, a tenfold increase from the previous 1MiB limit. This launch enables customers to publish intermittent larger data payl...

#AWS #AwsGovcloudUs #AmazonKinesisStreams

1 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

5 months ago

Amazon Kinesis Data Streams now supports 10x larger record sizes Amazon Kinesis Data Streams now supports record sizes up to 10MiB, a tenfold increase from the previous 1MiB limit. This launch enables customers to publish intermittent larger data payloads in their data streams while continuing to use existing Kinesis Data Streams APIs in their applications. This launch is accompanied by a 2x increase in the maximum PutRecords request size from 5MiB to 10MiB. Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store real-time data streams at any scale. With this launch, customers no longer need to maintain separate processing pipelines for handling intermittent large records, and can thus simplify their data pipelines. This reduces operational overhead for IoT analytics, change data capture, and generative AI workloads. You can update your stream's maximum record size up to 10 MiB using either the AWS Management Console or the UpdateMaxRecordSize API via the AWS SDK or CLI. Once your stream is configured, you can publish and consume larger records using existing Kinesis Data Streams APIs. You do not incur additional costs to use this capability beyond your regular Kinesis data streams charges. In conjunction with this launch, AWS Lambda now supports larger payloads up to 6MiB from Kinesis Data Streams. Amazon Kinesis Data Streams supports large records in the AWS Regions documented here. To learn more about using large records and how common downstream applications handle large records, please see our documentation.

🆕 Amazon Kinesis now supports 10x larger 10MiB records for IoT, analytics, and AI, easing data pipelines and reducing costs. No extra fees.

#AWS #AwsGovcloudUs #AmazonKinesisStreams

1 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

6 months ago

Amazon Kinesis Data Streams expands Internet Protocol version 6 support to the AWS GovCloud (US) Regions Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6) in the AWS GovCloud (US) Regions. Customers have the option of using either IPv6 or IPv4 when sending requests over dual-stack public or VPC endpoints. The new endpoints have also been validated under the Federal Information Processing Standard (FIPS) 140-3 program. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. IPv6 increases the number of available addresses by several orders of magnitude, so customers will no longer need to manage overlapping address spaces. Many devices and networks today already use IPv6, and now they can easily write to and read from data streams. FIPS-compliant endpoints help companies contracting with the US federal governments meet the FIPS security requirement to encrypt sensitive data in supported Regions. Support for IPv6 with Kinesis Data Streams is now available in all Regions where Kinesis Data Streams is available, including AWS GovCloud (US) and China Regions. See https://docs.aws.amazon.com/general/latest/gr/ak.html for a full listing of our Regions. To learn more about Kinesis Data Streams, please refer to our https://docs.aws.amazon.com/streams/latest/dev/introduction.html.

Amazon Kinesis Data Streams expands Internet Protocol version 6 support to the AWS GovCloud (US) Regions

Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6) in the AWS GovCloud (...

#AWS #AwsGovcloudUs #AmazonKinesis #AmazonKinesisStreams

1 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

6 months ago

Amazon Kinesis Data Streams expands Internet Protocol version 6 support to the AWS GovCloud (US) Regions Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6) in the AWS GovCloud (US) Regions. Customers have the option of using either IPv6 or IPv4 when sending requests over dual-stack public or VPC endpoints. The new endpoints have also been validated under the Federal Information Processing Standard (FIPS) 140-3 program. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. IPv6 increases the number of available addresses by several orders of magnitude, so customers will no longer need to manage overlapping address spaces. Many devices and networks today already use IPv6, and now they can easily write to and read from data streams. FIPS-compliant endpoints help companies contracting with the US federal governments meet the FIPS security requirement to encrypt sensitive data in supported Regions. Support for IPv6 with Kinesis Data Streams is now available in all Regions where Kinesis Data Streams is available, including AWS GovCloud (US) and China Regions. See here for a full listing of our Regions. To learn more about Kinesis Data Streams, please refer to our Developer Guide.

🆕 Amazon Kinesis Data Streams now supports IPv6 in AWS GovCloud (US) Regions, offering dual-stack endpoints validated under FIPS 140-3, enhancing address availability and security for federal contracts.

#AWS #AwsGovcloudUs #AmazonKinesis #AmazonKinesisStreams

1 1 0 0

AWS News(Unofficial)

@awsnews.bsky.social

10 months ago

Amazon Kinesis Data Streams expands IPv6 support to VPC endpoints Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6) with dual-stack AWS PrivateLink interface Virtual Private Clouds (VPC) endpoints. This enhancement extends IPv6 compatibility, previously available only for public endpoints, to VPC endpoints across all AWS Regions. Dual-stack endpoints that have been validated under the Federal Information Processing Standard (FIPS) 140-3 program are also available. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. Customers can now leverage IPv6 connectivity for data-streaming workloads within their Virtual Private Clouds (VPCs). IPv6 support is crucial for organizations facing IPv4 address exhaustion or those required to support IPv6 for compliance reasons. This feature allows for seamless integration of Kinesis Data Streams with IPv6-only networks, simplifying network management and reducing the need for complex IPv4 to IPv6 translations. IPv6 support for VPC endpoints is now available in all AWS Regions, including commercial regions and AWS China regions operated by Sinnet and NWCD. See https://docs.aws.amazon.com/general/latest/gr/ak.html for a full listing of our Regions and endpoints. To learn more about using Kinesis Data Streams with interface VPC endpoints, please refer to our https://docs.aws.amazon.com/streams/latest/dev/vpc.html. To learn more about AWS PrivateLink, see https://docs.aws.amazon.com/vpc/latest/privatelink/privatelink-access-aws-services.html.

Amazon Kinesis Data Streams expands IPv6 support to VPC endpoints

Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6) with dual-stack AWS PrivateLink interface Virtual Private Clouds (VPC) endpoints. This enh...

#AWS #AmazonKinesisStreams

0 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

10 months ago

Amazon Kinesis Data Streams expands IPv6 support to VPC endpoints Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6) with dual-stack AWS PrivateLink interface Virtual Private Clouds (VPC) endpoints. This enhancement extends IPv6 compatibility, previously available only for public endpoints, to VPC endpoints across all AWS Regions. Dual-stack endpoints that have been validated under the Federal Information Processing Standard (FIPS) 140-3 program are also available. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. Customers can now leverage IPv6 connectivity for data-streaming workloads within their Virtual Private Clouds (VPCs). IPv6 support is crucial for organizations facing IPv4 address exhaustion or those required to support IPv6 for compliance reasons. This feature allows for seamless integration of Kinesis Data Streams with IPv6-only networks, simplifying network management and reducing the need for complex IPv4 to IPv6 translations. IPv6 support for VPC endpoints is now available in all AWS Regions, including commercial regions and AWS China regions operated by Sinnet and NWCD. See here for a full listing of our Regions and endpoints. To learn more about using Kinesis Data Streams with interface VPC endpoints, please refer to our Developer Guide. To learn more about AWS PrivateLink, see accessing AWS services through AWS PrivateLink.

🆕 Amazon Kinesis Data Streams now supports IPv6 for VPC endpoints, enhancing IPv6 compatibility across all AWS Regions, including dual-stack endpoints validated under FIPS 140-3, aiding IPv4 exhaustion and compliance.

#AWS #AmazonKinesisStreams

1 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

11 months ago

Amazon Kinesis Data Streams now supports tagging and Attribute-Based Access Control for consumers Today, Amazon Kinesis Data Streams introduces support for tagging and Attribute-Based Access Control (ABAC) for enhanced fan-out consumers. You can register enhanced fan-out consumers to have dedicated low latency read throughput per shard, up to 2MB/s. ABAC is an authorization strategy that defines access permissions based on tags that can be attached to IAM users, roles, and AWS resources for fine-grained access control. This new feature enables you to apply tags for allocating costs and simplifying permission management for your enhanced fan-out consumers. With this launch, you can now tag your enhanced fan-out consumers used by different business units to track and allocate costs in AWS Cost Explorer without manually tracking costs per consumer. You can apply tags to enhanced fan-out consumers using the Kinesis Data Streams API or AWS Command Line Interface (CLI). Additionally, ABAC support for enhanced fan-out consumers allows you to use IAM policies to allow or deny specific Kinesis Data Streams API actions when the IAM principal's tags match the tags on a registered consumer. Tagging and Attribute-Based Access Control for enhanced fan-out consumers are available in all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/, including the AWS China and AWS GovCloud (US) Regions. To learn more about tagging and ABAC support for consumers, see https://docs.aws.amazon.com/streams/latest/dev/tagging.html and https://aws.amazon.com/identity/attribute-based-access-control/.

Amazon Kinesis Data Streams now supports tagging and Attribute-Based Access Control for consumers

Today, Amazon Kinesis Data Streams introduces support for tagging and Attribute-Based Access Control (ABAC) for enhanced fan-out consumers...

#AWS #AmazonKinesisStreams #AmazonKinesis #AwsGovcloudUs

0 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

11 months ago

Amazon Kinesis Data Streams now supports tagging and Attribute-Based Access Control for consumers Today, Amazon Kinesis Data Streams introduces support for tagging and Attribute-Based Access Control (ABAC) for enhanced fan-out consumers. You can register enhanced fan-out consumers to have dedicated low latency read throughput per shard, up to 2MB/s. ABAC is an authorization strategy that defines access permissions based on tags that can be attached to IAM users, roles, and AWS resources for fine-grained access control. This new feature enables you to apply tags for allocating costs and simplifying permission management for your enhanced fan-out consumers. With this launch, you can now tag your enhanced fan-out consumers used by different business units to track and allocate costs in AWS Cost Explorer without manually tracking costs per consumer. You can apply tags to enhanced fan-out consumers using the Kinesis Data Streams API or AWS Command Line Interface (CLI). Additionally, ABAC support for enhanced fan-out consumers allows you to use IAM policies to allow or deny specific Kinesis Data Streams API actions when the IAM principal's tags match the tags on a registered consumer. Tagging and Attribute-Based Access Control for enhanced fan-out consumers are available in all AWS Regions, including the AWS China and AWS GovCloud (US) Regions. To learn more about tagging and ABAC support for consumers, see Tag your resources and Attribute-Based Access Control (ABAC) for AWS.

🆕 Amazon Kinesis Data Streams now supports tagging and ABAC for enhanced fan-out consumers, enabling cost tracking and fine-grained access control via IAM tags, available in all AWS Regions.

#AWS #AmazonKinesisStreams #AmazonKinesis #AwsGovcloudUs

0 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

11 months ago

Amazon Kinesis Data Streams increases default shard limits to up to 20,000 per AWS account Amazon Kinesis Data Streams now offers significantly higher default shard limits for data streams in Provisioned capacity mode, increasing from 500 to 20,000 shards per AWS account in the US East (N. Virginia), US West (Oregon), and Europe (Ireland) regions. You can also see an account’s utilization of the shards limit in any region via the AWS Service Quotas console, so you can grow streaming workloads easily and quickly to bring real-time insights to more use cases. Amazon Kinesis Data Streams is a serverless data streaming service that allows customers to build de-coupled applications that publish and consume real-time data streams at any scale. A data stream is composed of shards, and each shard provides 1 MB/sec ingress and 2 MB/sec egress throughput capacity. You can easily change a stream’s throughput capacity by specifying its number of shards via the console, an API call, or the CLI. With the increased limits, customers using Provisioned mode can now process up to 10 GB/sec of ingress and 20 GB/sec of egress per account by default, and they can always request further increases to this limit. The default shard limits have also been increased from 200 to 1,000 shards or 6,000 shards per account for all other regions. You can view the new defaults for all regions and request further increases via the https://docs.aws.amazon.com/servicequotas/latest/userguide/request-quota-increase.html. For more information about how shard limits affect your data streams, see the https://docs.aws.amazon.com/streams/latest/dev/service-sizes-and-limits.htmldocumentation.

Amazon Kinesis Data Streams increases default shard limits to up to 20,000 per AWS account

Amazon Kinesis Data Streams now offers significantly higher default shard limits for data streams in Provisioned capacity mode, increasing from 500 to 20,000 sh...

#AWS #AwsGovcloudUs #AmazonKinesisStreams

0 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

11 months ago

Amazon Kinesis Data Streams increases default shard limits to up to 20,000 per AWS account Amazon Kinesis Data Streams now offers significantly higher default shard limits for data streams in Provisioned capacity mode, increasing from 500 to 20,000 shards per AWS account in the US East (N. Virginia), US West (Oregon), and Europe (Ireland) regions. You can also see an account’s utilization of the shards limit in any region via the AWS Service Quotas console, so you can grow streaming workloads easily and quickly to bring real-time insights to more use cases. Amazon Kinesis Data Streams is a serverless data streaming service that allows customers to build de-coupled applications that publish and consume real-time data streams at any scale. A data stream is composed of shards, and each shard provides 1 MB/sec ingress and 2 MB/sec egress throughput capacity. You can easily change a stream’s throughput capacity by specifying its number of shards via the console, an API call, or the CLI. With the increased limits, customers using Provisioned mode can now process up to 10 GB/sec of ingress and 20 GB/sec of egress per account by default, and they can always request further increases to this limit. The default shard limits have also been increased from 200 to 1,000 shards or 6,000 shards per account for all other regions. You can view the new defaults for all regions and request further increases via the Service Quotas console. For more information about how shard limits affect your data streams, see the Quotas and Limits documentation.

🆕 Amazon Kinesis Data Streams raises default shard limits to 20,000 per account in select regions, boosting data throughput to 10 GB/sec ingress and 20 GB/sec egress. Other regions see a rise from 200 to 1,000 shards. Manage limits via AWS Service Quotas.

#AWS #AwsGovcloudUs #AmazonKinesisStreams

0 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

1 year ago

Amazon Kinesis Data Streams now supports Internet Protocol version 6 Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6). Customers now have the option of using either IPv6 or IPv4 when sending requests over dual-stack public endpoints. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. IPv6 increases the number of available addresses by several orders of magnitude, so customers will no longer need to manage overlapping address spaces. Many devices and networks today already use IPv6, and now they can easily write to and read from data streams. Support for IPv6 with Kinesis Data Streams is available in all Regions where Kinesis Data Streams is available, except for AWS GovCloud (US) and China Regions. See https://docs.aws.amazon.com/general/latest/gr/ak.html for a full listing of our Regions. To learn more about Kinesis Data Streams, please refer to our https://docs.aws.amazon.com/streams/latest/dev/introduction.html.

Amazon Kinesis Data Streams now supports Internet Protocol version 6

Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6). Customers now have the option of using either IPv6 or IPv4 when sending...

#AWS #AmazonKinesisStreams #AwsGovcloudUs

0 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

Amazon Kinesis Data Streams now supports Internet Protocol version 6 Amazon Kinesis Data Streams now allows customers to make API requests over Internet Protocol version 6 (IPv6). Customers now have the option of using either IPv6 or IPv4 when sending requests over dual-stack public endpoints. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. IPv6 increases the number of available addresses by several orders of magnitude, so customers will no longer need to manage overlapping address spaces. Many devices and networks today already use IPv6, and now they can easily write to and read from data streams. Support for IPv6 with Kinesis Data Streams is available in all Regions where Kinesis Data Streams is available, except for AWS GovCloud (US) and China Regions. See here for a full listing of our Regions. To learn more about Kinesis Data Streams, please refer to our Developer Guide.

🆕 Amazon Kinesis Data Streams now supports IPv6, allowing dual-stack public endpoint requests. This expands address options, aiding devices and networks already using IPv6. Available in all regions except AWS GovCloud (US) and China.

#AWS #AmazonKinesisStreams #AwsGovcloudUs

0 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

1 year ago

Kinesis Producer Library now supports the AWS SDK for Java 2.x AWS announces a new version of https://github.com/awslabs/amazon-kinesis-producer/tree/master that supports the AWS SDK for Java 2.x for improved performance and security features. With the new KPL version 1.0, now you can fully remove the dependency on the AWS SDK for Java 1.x. You can upgrade your applications running previous KPL versions to KPL 1.0 without any change in your core data processing logic. Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store real-time data streams at any scale. Kinesis Producer Library is an open-source library that simplifies producer application development, enabling developers to achieve high write throughput to a Kinesis data stream by aggregating and batching the data. KPL 1.0 is available with Amazon Kinesis Data Streams in all AWS regions. To learn more, see the https://docs.aws.amazon.com/streams/latest/dev/kpl-migration-1x.html and https://github.com/awslabs/amazon-kinesis-producer?tab=readme-ov-file#100.

Kinesis Producer Library now supports the AWS SDK for Java 2.x

AWS announces a new version of github.com/awslabs/amazon-kinesis-p... that supports the AWS SDK for Java 2.x for improved performance and security features. With the new KPL versi...

#AWS #AmazonKinesisStreams

0 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

Kinesis Producer Library now supports the AWS SDK for Java 2.x AWS announces a new version of Kinesis Producer Library (KPL) that supports the AWS SDK for Java 2.x for improved performance and security features. With the new KPL version 1.0, now you can fully remove the dependency on the AWS SDK for Java 1.x. You can upgrade your applications running previous KPL versions to KPL 1.0 without any change in your core data processing logic. Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store real-time data streams at any scale. Kinesis Producer Library is an open-source library that simplifies producer application development, enabling developers to achieve high write throughput to a Kinesis data stream by aggregating and batching the data. KPL 1.0 is available with Amazon Kinesis Data Streams in all AWS regions. To learn more, see the Amazon Kinesis Data Streams developer guide and KPL 1.0 release notes.

🆕 Kinesis Producer Library now supports the AWS SDK for Java 2.x

#AWS #AmazonKinesisStreams

0 0 0 0

AWS News(Unofficial)

@awsnews.bsky.social

1 year ago

Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector Amazon Managed Service for Apache Flink now offers a new Apache Flink connector for Amazon Kinesis Data Streams. This open-source connector, contributed by AWS, supports Apache Flink 2.0 and provides several enhancements. It enables in-order reads during stream scale-up or scale-down, supports Apache Flink's native watermarking, and improves observability through unified connector metrics. Additionally, the connector uses AWS SDK for Java 2.x which supports enhanced performance and security features, and native retry strategy. Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store data streams at any scale. Amazon Managed Service for Apache Flink makes it easier to transform and analyze streaming data in real time with Apache Flink without having to manage servers or clusters. You can use the new connector to consume data from a Kinesis Data Stream source for real-time processing in your Apache Flink application and can also send data back to a Kinesis Data Streams destination. You can use the new connector to read data from a Kinesis data stream starting with Apache Flink version 1.19. To learn more about Apache Flink Amazon Kinesis Data Streams connector, visit the https://nightlies.apache.org/flink/flink-docs-stable/docs/connectors/datastream/kinesis/. You can also check the https://github.com/apache/flink-connector-aws.

Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector

Amazon Managed Service for Apache Flink now offers a new Apache Flink connector for Amazon Kinesis Data Streams. This open...

#AWS #AmazonKinesisStreams #AmazonManagedServiceForApacheFlink #AwsGovcloudUs

1 1 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector Amazon Managed Service for Apache Flink now offers a new Apache Flink connector for Amazon Kinesis Data Streams. This open-source connector, contributed by AWS, supports Apache Flink 2.0 and provides several enhancements. It enables in-order reads during stream scale-up or scale-down, supports Apache Flink's native watermarking, and improves observability through unified connector metrics. Additionally, the connector uses AWS SDK for Java 2.x which supports enhanced performance and security features, and native retry strategy. Amazon Kinesis Data Streams is a serverless data streaming service that enables customers to capture, process, and store data streams at any scale. Amazon Managed Service for Apache Flink makes it easier to transform and analyze streaming data in real time with Apache Flink without having to manage servers or clusters. You can use the new connector to consume data from a Kinesis Data Stream source for real-time processing in your Apache Flink application and can also send data back to a Kinesis Data Streams destination. You can use the new connector to read data from a Kinesis data stream starting with Apache Flink version 1.19. To learn more about Apache Flink Amazon Kinesis Data Streams connector, visit the official Apache Flink documentation. You can also check the GitHub repositories for Apache AWS connectors.

🆕 Amazon Managed Service for Apache Flink releases a new Amazon Kinesis Data Streams connector

#AWS #AmazonKinesisStreams #AmazonManagedServiceForApacheFlink #AwsGovcloudUs

0 1 0 0

AWS News(Unofficial)

@awsnews.bsky.social

1 year ago

Amazon Kinesis Data Streams On-Demand mode supports streams writing up to 10GB/s Amazon Kinesis Data Streams On-Demand Mode now automatically scales to support streaming applications that write up to 10GB/s per stream and consumers that read up to 20 GB/s per stream. This is a 5x increase from the previously supported limits of 2 GB/s per stream for writers and 4 GB/s for readers. Amazon Kinesis Data Streams is a serverless data streaming service that allows customers to build de-coupled applications that publish and consume real-time data streams. It includes integrations with 40+ AWS and third-party services, enabling customers to easily build real-time stream processing, analytics, and machine learning applications. Customers use Kinesis Data Streams On-demand Mode for workloads with unpredictable and variable traffic patterns, so they do not have to manage capacity. They can pay based on the amount of data streamed. Customers can now use On-demand Mode for high-throughput data streams. There is no action required on your part to use this feature in US East (N. Virginia), US West (Oregon) and Europe (Ireland) AWS Regions. When you write data to your Kinesis On-demand stream, it will automatically scale to write up to 10 GB/s. For other AWS Regions, you can reach out tohttps://support.console.aws.amazon.com/support/home#/case/create?issueType=service-limit-increase&limitType=kinesis-streams to raise the peak write throughput capacity of your OD Streams to 10 GB/s. To learn more, see the Kinesis Data Streams https://docs.aws.amazon.com/streams/latest/dev/service-sizes-and-limits.html documentation.

Amazon Kinesis Data Streams On-Demand mode supports streams writing up to 10GB/s

Amazon Kinesis Data Streams On-Demand Mode now automatically scales to support streaming applications that write up to 10GB/s per stream and consumers that...

#AWS #AmazonKinesis #AwsGovcloudUs #AmazonKinesisStreams

1 1 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

Amazon Kinesis Data Streams On-Demand mode supports streams writing up to 10GB/s Amazon Kinesis Data Streams On-Demand Mode now automatically scales to support streaming applications that write up to 10GB/s per stream and consumers that read up to 20 GB/s per stream. This is a 5x increase from the previously supported limits of 2 GB/s per stream for writers and 4 GB/s for readers. Amazon Kinesis Data Streams is a serverless data streaming service that allows customers to build de-coupled applications that publish and consume real-time data streams. It includes integrations with 40+ AWS and third-party services, enabling customers to easily build real-time stream processing, analytics, and machine learning applications. Customers use Kinesis Data Streams On-demand Mode for workloads with unpredictable and variable traffic patterns, so they do not have to manage capacity. They can pay based on the amount of data streamed. Customers can now use On-demand Mode for high-throughput data streams. There is no action required on your part to use this feature in US East (N. Virginia), US West (Oregon) and Europe (Ireland) AWS Regions. When you write data to your Kinesis On-demand stream, it will automatically scale to write up to 10 GB/s. For other AWS Regions, you can reach out to AWS support to raise the peak write throughput capacity of your OD Streams to 10 GB/s. To learn more, see the Kinesis Data Streams Quotas and Limits documentation.

🆕 Amazon Kinesis Data Streams On-Demand mode supports streams writing up to 10GB/s

#AWS #AmazonKinesis #AwsGovcloudUs #AmazonKinesisStreams

1 1 0 0

AWS News(Unofficial)

@awsnews.bsky.social

1 year ago

Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams Amazon OpenSearch Ingestion now allows you to ingest records from Amazon Kinesis Data Streams, enabling you to seamlessly index streaming data in Amazon OpenSearch Service managed clusters or serverless collections without the need for any third-party data connectors. With this integration, you can now use Amazon OpenSearch Ingestion to perform near- real-time aggregations, sampling and anomaly detection on data ingested from Amazon Kinesis Data Streams, helping you to build efficient data pipelines to power your event-driven applications and real-time analytics use cases. Amazon OpenSearch Ingestion pipelines can consume data records from one or more Amazon Kinesis Data Streams and transform the data before writing it to Amazon OpenSearch Service or Amazon S3. While reading data from Amazon Kinesis Data Streams via Amazon OpenSearch Ingestion, you have the option to use either enhanced fan-out or shared reads, giving you the flexibility to balance speed and cost. You can also check out this blog https://aws.amazon.com/blogs/big-data/use-amazon-kinesis-data-streams-to-deliver-real-time-data-to-amazon-opensearch-service-domains-with-amazon-opensearch-ingestion/ to learn more about this feature. This feature is available in all the 15 AWS commercial regions where Amazon OpenSearch Ingestion is currently available: US East (Ohio), US East (N. Virginia), US West (Oregon), US West (N. California), Europe (Ireland), Europe (London), Europe (Frankfurt), Asia Pacific (Tokyo), Asia Pacific (Sydney), Asia Pacific (Singapore), Asia Pacific (Mumbai), Asia Pacific (Seoul), Canada (Central), South America (Sao Paulo), and Europe (Stockholm). To learn more, see the https://aws.amazon.com/opensearch-service/features/ingestion/ webpage and the https://docs.aws.amazon.com/opensearch-service/latest/developerguide/configure-client-kinesis.html.

Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams

Amazon OpenSearch Ingestion now allows you to ingest records from Amazon Kinesis Data Streams, enabling you to seamlessly index streaming data in Amazon OpenSearch Service m...

#AWS #AmazonKinesisStreams

1 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams Amazon OpenSearch Ingestion now allows you to ingest records from Amazon Kinesis Data Streams, enabling you to seamlessly index streaming data in Amazon OpenSearch Service managed clusters or serverless collections without the need for any third-party data connectors. With this integration, you can now use Amazon OpenSearch Ingestion to perform near- real-time aggregations, sampling and anomaly detection on data ingested from Amazon Kinesis Data Streams, helping you to build efficient data pipelines to power your event-driven applications and real-time analytics use cases. Amazon OpenSearch Ingestion pipelines can consume data records from one or more Amazon Kinesis Data Streams and transform the data before writing it to Amazon OpenSearch Service or Amazon S3. While reading data from Amazon Kinesis Data Streams via Amazon OpenSearch Ingestion, you have the option to use either enhanced fan-out or shared reads, giving you the flexibility to balance speed and cost. You can also check out this blog post to learn more about this feature. This feature is available in all the 15 AWS commercial regions where Amazon OpenSearch Ingestion is currently available: US East (Ohio), US East (N. Virginia), US West (Oregon), US West (N. California), Europe (Ireland), Europe (London), Europe (Frankfurt), Asia Pacific (Tokyo), Asia Pacific (Sydney), Asia Pacific (Singapore), Asia Pacific (Mumbai), Asia Pacific (Seoul), Canada (Central), South America (Sao Paulo), and Europe (Stockholm). To learn more, see the Amazon OpenSearch Ingestion webpage and the Amazon OpenSearch Service Developer Guide.

🆕 Amazon OpenSearch Ingestion adds support for ingesting data from Amazon Kinesis Data Streams

#AWS #AmazonKinesisStreams

1 1 0 0

AWS News(Unofficial)

@awsnews.bsky.social

1 year ago

Amazon Kinesis Data Streams launches CloudFormation support for resource policies Amazon Kinesis Data Streams now provides AWS CloudFormation supports for managing resource policies for data streams and consumers. You can use CloudFormation templates to programmatically deploy resource policies in a secure, efficient, and repeatable way, reducing the risk of human error from manual configuration. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. CloudFormation uses stacks to manage AWS resources, allowing you to track changes, apply updates automatically, and easily roll back changes when needed. CloudFormation support for resource policies is available in all https://aws.amazon.com/about-aws/global-infrastructure/regional-product-services/ where Amazon Kinesis Data Streams is offered, including the AWS GovCloud (US) Regions and China Regions. To learn more about Amazon Kinesis Data Streams resource policies, visit the https://docs.aws.amazon.com/streams/latest/dev/controlling-access.html#sharing-data-streams.

Amazon Kinesis Data Streams launches CloudFormation support for resource policies

Amazon Kinesis Data Streams now provides AWS CloudFormation supports for managing resource policies for data streams and consumers. You can use CloudForma...

#AWS #AmazonKinesisStreams #AmazonKinesis #AwsGovcloudUs

2 0 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

Amazon Kinesis Data Streams launches CloudFormation support for resource policies Amazon Kinesis Data Streams now provides AWS CloudFormation supports for managing resource policies for data streams and consumers. You can use CloudFormation templates to programmatically deploy resource policies in a secure, efficient, and repeatable way, reducing the risk of human error from manual configuration. Kinesis Data Streams allows users to capture, process, and store data streams in real time at any scale. CloudFormation uses stacks to manage AWS resources, allowing you to track changes, apply updates automatically, and easily roll back changes when needed. CloudFormation support for resource policies is available in all AWS regions where Amazon Kinesis Data Streams is offered, including the AWS GovCloud (US) Regions and China Regions. To learn more about Amazon Kinesis Data Streams resource policies, visit the developer guide.

🆕 Amazon Kinesis Data Streams launches CloudFormation support for resource policies

#AWS #AmazonKinesisStreams #AmazonKinesis #AwsGovcloudUs

1 2 0 0

AWS News Feed on 🦋

@awsrecentnews.bsky.social

1 year ago

New Kinesis Client Library 3.0 reduces stream processing compute costs by up to 33% You can now reduce compute costs to process streaming data with Kinesis Client Library (KCL) 3.0 by up to 33% compared to previous KCL versions. KCL 3.0 introduces an enhanced load balancing algorithm that continuously monitors resource utilization of the stream processing workers and automatically redistributes the load from over-utilized workers to other underutilized workers. This ensures even CPU utilization across workers and removes the need to over-provision the stream processing compute workers which reduces cost. Additionally, KCL 3.0 is built with the AWS SDK for Java 2.x for improved performance and security features, fully removing the dependency on the AWS SDK for Java 1.x. KCL is an open-source library that simplifies the development of stream processing applications with Amazon Kinesis Data Streams. It manages complex tasks associated with distributed computing such as load balancing, fault tolerance, and service coordination, allowing you to solely focus on your core business logic. You can upgrade your stream processing application running on KCL 2.x by simply replacing the current library using KCL 3.0, without any changes in your application code. KCL 3.0 supports stream processing applications running on Amazon EC2 instances or containers such as Amazon ECS, Amazon EKS, or AWS Fargate. KCL 3.0 is available with Amazon Kinesis Data Streams in all AWS regions. To learn more, see the Amazon Kinesis Data Streams developer guide, KCL 3.0 release notes, and launch blog.

New Kinesis Client Library 3.0 reduces stream processing compute costs by up to 33% #AmazonKinesisStreams

1 1 0 1