<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"><channel><title>Cloudflare changelogs | R2 Data Catalog</title><description>Cloudflare changelogs for R2 Data Catalog</description><link>https://developers.stormtrust.net/changelog/</link><item><title>R2, R2 Data Catalog - Billing is now enabled for R2 Data Catalog</title><link>https://developers.stormtrust.net/changelog/post/2026-08-03-r2-data-catalog-billing-enabled/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-08-03-r2-data-catalog-billing-enabled/</guid><description>&lt;p&gt;Billing is now enabled for &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; on non-enterprise accounts. R2 Data Catalog usage beyond the included free tier will appear on your next invoice.&lt;/p&gt;
&lt;p&gt;R2 Data Catalog charges based on two dimensions, in addition to standard &lt;a href=&quot;https://developers.stormtrust.net/r2/pricing/&quot;&gt;R2 storage and operations&lt;/a&gt;:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Catalog operations&lt;/strong&gt;: $9.00 / million operations for metadata requests such as creating tables, reading table metadata, and updating table properties.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Compaction&lt;/strong&gt;: $0.005 / GB processed and $2.00 / million objects processed. These charges only apply when &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;automatic compaction&lt;/a&gt; is turned on for a table.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Each dimension includes a monthly free tier: 1 million catalog operations, 10 GB of compaction data processed, and 1 million compaction objects processed.&lt;/p&gt;
&lt;p&gt;For example, a single Iceberg table with 50 GB of data, 500,000 catalog operations per month, and compaction turned on that processes 20 GB across 200,000 files would be billed as follows:&lt;/p&gt;
&lt;div class=&quot;table-scroll&quot; tabindex=&quot;0&quot; role=&quot;region&quot; aria-label=&quot;Table&quot;&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Dimension&lt;/th&gt;
&lt;th&gt;Usage&lt;/th&gt;
&lt;th&gt;Included&lt;/th&gt;
&lt;th&gt;Billable&lt;/th&gt;
&lt;th&gt;Cost&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Catalog operations&lt;/td&gt;
&lt;td&gt;500,000&lt;/td&gt;
&lt;td&gt;1,000,000&lt;/td&gt;
&lt;td&gt;0&lt;/td&gt;
&lt;td&gt;$0.00&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Compaction (data processed)&lt;/td&gt;
&lt;td&gt;20 GB&lt;/td&gt;
&lt;td&gt;10 GB&lt;/td&gt;
&lt;td&gt;10 GB&lt;/td&gt;
&lt;td&gt;$0.05&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Compaction (objects)&lt;/td&gt;
&lt;td&gt;200,000&lt;/td&gt;
&lt;td&gt;1,000,000&lt;/td&gt;
&lt;td&gt;0&lt;/td&gt;
&lt;td&gt;$0.00&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;strong&gt;Total (Data Catalog)&lt;/strong&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;/td&gt;
&lt;td&gt;&lt;strong&gt;$0.05&lt;/strong&gt;&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;
&lt;p&gt;Standard R2 storage charges ($0.015 / GB-month) apply separately for the 50 GB of data stored.&lt;/p&gt;
&lt;p&gt;For full pricing details and billing examples, refer to &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/platform/pricing/&quot;&gt;R2 Data Catalog pricing&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Mon, 03 Aug 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog now supports read-only API tokens</title><link>https://developers.stormtrust.net/changelog/post/2026-07-09-r2-data-catalog-read-only-tokens/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-07-09-r2-data-catalog-read-only-tokens/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; now accepts read-only API tokens, so query engines and clients that only read data no longer need a read-write token. Previously, every catalog operation required an &lt;strong&gt;Admin Read &amp;amp; Write&lt;/strong&gt; token, which granted read-only clients more access than they needed.&lt;/p&gt;
&lt;p&gt;You can now authenticate your Iceberg engine based on your workload:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Read-only&lt;/strong&gt; operations (such as listing namespaces, loading tables, and querying data) work with an &lt;strong&gt;Admin Read only&lt;/strong&gt; token (R2 Data Catalog read and R2 storage read).&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Write&lt;/strong&gt; operations (such as creating or dropping tables and committing transactions) continue to require an &lt;strong&gt;Admin Read &amp;amp; Write&lt;/strong&gt; token.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;This lets you follow the principle of least privilege — for example, using a read-write token for the pipeline that writes to your tables and read-only tokens for engines like &lt;a href=&quot;https://developers.stormtrust.net/r2-sql/&quot;&gt;R2 SQL&lt;/a&gt;, &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/duckdb/&quot;&gt;DuckDB&lt;/a&gt;, or &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/pyiceberg/&quot;&gt;PyIceberg&lt;/a&gt; that query them.&lt;/p&gt;
&lt;p&gt;Note that credentials vended by the catalog inherit the R2 storage permissions of the token used to authenticate. To ensure read-only access to your underlying data, scope the R2 storage permission to read-only as well.&lt;/p&gt;
&lt;p&gt;For details on choosing and creating the right token, refer to &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/manage-catalogs/#authenticate-your-iceberg-engine&quot;&gt;Authenticate your Iceberg engine&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Mon, 13 Jul 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2 Data Catalog - R2 Data Catalog compaction now optimizes manifest files</title><link>https://developers.stormtrust.net/changelog/post/2026-07-13-r2-data-catalog-manifest-optimization/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-07-13-r2-data-catalog-manifest-optimization/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt;, a managed &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; catalog built into R2, now automatically optimizes manifest files as part of &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;compaction&lt;/a&gt;.&lt;/p&gt;
&lt;p&gt;Manifest files track the data files that make up an Iceberg table. As a table accumulates many small or fragmented manifests, query engines must read more metadata during query planning, which slows down queries even before any data is scanned.&lt;/p&gt;
&lt;p&gt;When compaction runs, R2 Data Catalog now rewrites and clusters manifest files by partition as a best-effort pre-step. This consolidates fragmented manifests, reduces the number of manifests a query engine must open, and lowers metadata I/O overhead. Tables that are already well-clustered are skipped, so the operation only runs when it provides a benefit.&lt;/p&gt;
&lt;p&gt;This happens automatically for tables with compaction enabled — no configuration changes are required.&lt;/p&gt;
&lt;p&gt;For more information, refer to &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;Table maintenance&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Mon, 13 Jul 2026 00:00:00 GMT</pubDate><product>R2 Data Catalog</product><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog warns before you delete data manually</title><link>https://developers.stormtrust.net/changelog/post/2026-07-06-r2-data-catalog-delete-warnings/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-07-06-r2-data-catalog-delete-warnings/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; is a managed &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; catalog built directly into your R2 bucket. Iceberg tracks your data through a tree of metadata files, so every insert, update, and delete must go through a catalog transaction. Manually adding, modifying, or deleting objects outside the catalog can leave pointers referencing files that no longer exist, corrupting the table into an inconsistent state that is difficult to recover from.&lt;/p&gt;
&lt;p&gt;To help prevent this, the R2 dashboard and Wrangler now warn you when you attempt a manual delete operation on a Data Catalog-enabled bucket.&lt;/p&gt;
&lt;div tabindex=&quot;-1&quot; class=&quot;heading-wrapper level-h4&quot;&gt;&lt;h4 id=&quot;dashboard&quot;&gt;Dashboard&lt;/h4&gt;&lt;a class=&quot;anchor-link&quot; href=&quot;#dashboard&quot;&gt;&lt;span aria-hidden=&quot;true&quot; class=&quot;anchor-icon&quot;&gt;&lt;svg width=&quot;16&quot; height=&quot;16&quot; viewBox=&quot;0 0 24 24&quot;&gt;&lt;path fill=&quot;currentcolor&quot; d=&quot;m12.11 15.39-3.88 3.88a2.52 2.52 0 0 1-3.5 0 2.47 2.47 0 0 1 0-3.5l3.88-3.88a1 1 0 0 0-1.42-1.42l-3.88 3.89a4.48 4.48 0 0 0 6.33 6.33l3.89-3.88a1 1 0 1 0-1.42-1.42Zm8.58-12.08a4.49 4.49 0 0 0-6.33 0l-3.89 3.88a1 1 0 0 0 1.42 1.42l3.88-3.88a2.52 2.52 0 0 1 3.5 0 2.47 2.47 0 0 1 0 3.5l-3.88 3.88a1 1 0 1 0 1.42 1.42l3.88-3.89a4.49 4.49 0 0 0 0-6.33ZM8.83 15.17a1 1 0 0 0 1.1.22 1 1 0 0 0 .32-.22l4.92-4.92a1 1 0 0 0-1.42-1.42l-4.92 4.92a1 1 0 0 0 0 1.42Z&quot;&gt;&lt;/path&gt;&lt;/svg&gt;&lt;/span&gt;&lt;/a&gt;&lt;/div&gt;
&lt;p&gt;When you try to delete objects from a bucket that has R2 Data Catalog enabled, the dashboard displays a warning explaining that the operation could leave the catalog in an invalid state, with a link to the documentation for deleting data correctly. You can cancel the operation or choose to proceed anyway.&lt;/p&gt;
&lt;img src=&quot;https://developers.stormtrust.net/cdn-cgi/image/onerror=redirect,width=1886,height=684,format=webp/_astro/data-catalog-delete-warning.DoBR0sFO.png&quot; alt=&quot;R2 dashboard warning shown before deleting objects from a Data Catalog-enabled bucket&quot; loading=&quot;lazy&quot; decoding=&quot;async&quot; width=&quot;1886&quot; height=&quot;684&quot;&gt;
&lt;div tabindex=&quot;-1&quot; class=&quot;heading-wrapper level-h4&quot;&gt;&lt;h4 id=&quot;wrangler&quot;&gt;Wrangler&lt;/h4&gt;&lt;a class=&quot;anchor-link&quot; href=&quot;#wrangler&quot;&gt;&lt;span aria-hidden=&quot;true&quot; class=&quot;anchor-icon&quot;&gt;&lt;svg width=&quot;16&quot; height=&quot;16&quot; viewBox=&quot;0 0 24 24&quot;&gt;&lt;path fill=&quot;currentcolor&quot; d=&quot;m12.11 15.39-3.88 3.88a2.52 2.52 0 0 1-3.5 0 2.47 2.47 0 0 1 0-3.5l3.88-3.88a1 1 0 0 0-1.42-1.42l-3.88 3.89a4.48 4.48 0 0 0 6.33 6.33l3.89-3.88a1 1 0 1 0-1.42-1.42Zm8.58-12.08a4.49 4.49 0 0 0-6.33 0l-3.89 3.88a1 1 0 0 0 1.42 1.42l3.88-3.88a2.52 2.52 0 0 1 3.5 0 2.47 2.47 0 0 1 0 3.5l-3.88 3.88a1 1 0 1 0 1.42 1.42l3.88-3.89a4.49 4.49 0 0 0 0-6.33ZM8.83 15.17a1 1 0 0 0 1.1.22 1 1 0 0 0 .32-.22l4.92-4.92a1 1 0 0 0-1.42-1.42l-4.92 4.92a1 1 0 0 0 0 1.42Z&quot;&gt;&lt;/path&gt;&lt;/svg&gt;&lt;/span&gt;&lt;/a&gt;&lt;/div&gt;
&lt;p&gt;Wrangler now checks whether a bucket is Data Catalog-enabled before running a delete and warns you before continuing:&lt;/p&gt;
&lt;figure class=&quot;nb-code-figure&quot; data-nb-lang=&quot;txt&quot;&gt;&lt;pre class=&quot;astro-code astro-code-themes github-light github-dark nb-shiki-c6xiwz&quot; tabindex=&quot;0&quot; data-language=&quot;txt&quot; data-nb-lang=&quot;txt&quot;&gt;&lt;code&gt;&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-wvjl67&quot;&gt;Data Catalog is enabled for this bucket. &lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-wvjl67&quot;&gt;Proceeding may leave the data catalog in an invalid state. Continue?&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;
&lt;p&gt;To learn how to safely manage and delete data in your tables, refer to the &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog documentation&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Tue, 07 Jul 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog pricing announced</title><link>https://developers.stormtrust.net/changelog/post/2026-05-11-r2-data-catalog-pricing-announced/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-05-11-r2-data-catalog-pricing-announced/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; is a managed &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; data catalog built directly into R2 buckets, queryable by any Iceberg-compatible engine such as Spark, Snowflake, and DuckDB. R2 Data Catalog now has published pricing for catalog operations and table compaction, in addition to standard &lt;a href=&quot;https://developers.stormtrust.net/r2/pricing/&quot;&gt;R2 storage and operations&lt;/a&gt;.&lt;/p&gt;
&lt;p&gt;Billing is not yet enabled. We will provide at least 30 days notice before we start charging for R2 Data Catalog usage.&lt;/p&gt;
&lt;p&gt;Pricing is based on two dimensions:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Catalog operations&lt;/strong&gt;: $9.00 / million operations for metadata requests such as creating tables, reading table metadata, and updating table properties.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Compaction&lt;/strong&gt;: $0.005 / GB processed and $2.00 / million objects processed. These charges only apply when automatic compaction is turned on for a table.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Both dimensions include a monthly free tier: 1 million catalog operations, 10 GB of compaction data processed, and 1 million compaction objects processed.&lt;/p&gt;
&lt;p&gt;For full pricing details and billing examples, refer to &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/platform/pricing/&quot;&gt;R2 Data Catalog pricing&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Thu, 28 May 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog gets a dedicated dashboard experience</title><link>https://developers.stormtrust.net/changelog/post/2026-05-28-r2-data-catalog-dashboard/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-05-28-r2-data-catalog-dashboard/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; is a managed &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; data catalog built directly into your R2 bucket. It exposes a standard Iceberg REST catalog interface so you can connect query engines like &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/spark-scala/&quot;&gt;Spark&lt;/a&gt;, &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/snowflake/&quot;&gt;Snowflake&lt;/a&gt;, &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/duckdb/&quot;&gt;DuckDB&lt;/a&gt;, and &lt;a href=&quot;https://developers.stormtrust.net/r2-sql/&quot;&gt;R2 SQL&lt;/a&gt; to your data in R2.&lt;/p&gt;
&lt;p&gt;R2 Data Catalog now has a dedicated section in the Cloudflare dashboard, replacing the previous settings panel embedded in R2 bucket configuration. The new experience includes:&lt;/p&gt;
&lt;img src=&quot;https://developers.stormtrust.net/cdn-cgi/image/onerror=redirect,width=3070,height=1486,format=webp/_astro/data-catalog-dashboard.BsKDvUQn.png&quot; alt=&quot;R2 Data Catalog dashboard overview&quot; loading=&quot;lazy&quot; decoding=&quot;async&quot; width=&quot;3070&quot; height=&quot;1486&quot;&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;Catalog overview&lt;/strong&gt; — View all your catalogs in one place with catalog request counts, bucket sizes, and table maintenance status at a glance.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Guided setup wizard&lt;/strong&gt; — Create a catalog in three steps: choose or create an R2 bucket, configure table maintenance (compaction and snapshot expiration), and review. The wizard creates the bucket and generates a service credential automatically.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Settings management&lt;/strong&gt; — A dedicated settings page for each catalog with sections for general configuration, table maintenance, service credentials, and disabling the catalog. You can now enable and configure &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;snapshot expiration&lt;/a&gt; directly from the dashboard.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;Built-in metrics&lt;/strong&gt; — Five charts on each catalog&apos;s metrics tab: bytes compacted, files compacted, catalog requests, storage size, and snapshots expired.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;To get started, go to &lt;strong&gt;R2 Data Catalog&lt;/strong&gt; in the Cloudflare dashboard or refer to the &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/get-started/&quot;&gt;getting started guide&lt;/a&gt; and &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/manage-catalogs/&quot;&gt;manage catalogs documentation&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Thu, 28 May 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog now exposes metrics via the GraphQL Analytics API</title><link>https://developers.stormtrust.net/changelog/post/2026-05-12-r2-data-catalog-graphql-analytics/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-05-12-r2-data-catalog-graphql-analytics/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; is a managed Apache Iceberg data catalog built directly into your R2 bucket that allows you to connect query engines like &lt;a href=&quot;https://developers.stormtrust.net/r2-sql/&quot;&gt;R2 SQL&lt;/a&gt;, Spark, Snowflake, and DuckDB to your data in R2.&lt;/p&gt;
&lt;p&gt;You can now query analytics for your R2 Data Catalog warehouses via Cloudflare&apos;s &lt;a href=&quot;https://developers.stormtrust.net/analytics/graphql-api/&quot;&gt;GraphQL Analytics API&lt;/a&gt;. Two new datasets are available:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;strong&gt;&lt;code&gt;r2CatalogDataOperationsAdaptiveGroups&lt;/code&gt;&lt;/strong&gt; tracks Iceberg REST API requests made to your catalog, including operation type, request duration, HTTP status, and request body bytes. Use this to monitor request volume and latency across warehouses, namespaces, and tables.&lt;/li&gt;
&lt;li&gt;&lt;strong&gt;&lt;code&gt;r2CatalogTableMaintenanceAdaptiveGroups&lt;/code&gt;&lt;/strong&gt; tracks table maintenance jobs such as compaction and snapshot expiration. Use this to monitor job success rates, files processed, bytes read and written, and job duration.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Both datasets support filtering by warehouse name, namespace, table name, and time range. They also include percentile aggregations for duration metrics.&lt;/p&gt;
&lt;p&gt;For detailed schema information and example queries, refer to the &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/observability/metrics/&quot;&gt;R2 Data Catalog metrics and analytics documentation&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Tue, 12 May 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog snapshot expiration now removes unreferenced data files</title><link>https://developers.stormtrust.net/changelog/post/2026-04-22-snapshot-expiration-cleans-data-files/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2026-04-22-snapshot-expiration-cleans-data-files/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt;, a managed &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; catalog built into R2, now removes unreferenced data files during automatic snapshot expiration. This improvement reduces storage costs and eliminates the need to run manual maintenance jobs to reclaim space from deleted data.&lt;/p&gt;
&lt;p&gt;Previously, snapshot expiration only cleaned up Iceberg metadata files such as manifests and manifest lists. Data files that were no longer referenced by active snapshots remained in R2 storage until you manually ran &lt;code&gt;remove_orphan_files&lt;/code&gt; or &lt;code&gt;expire_snapshots&lt;/code&gt; through an engine like Spark. This required extra operational overhead and left stale data files consuming storage.&lt;/p&gt;
&lt;p&gt;Snapshot expiration now handles both metadata and data file cleanup automatically. When a snapshot is expired, any data files that are no longer referenced by retained snapshots are removed from R2 storage.&lt;/p&gt;
&lt;figure class=&quot;nb-code-figure&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;pre class=&quot;astro-code astro-code-themes github-light github-dark nb-shiki-c6xiwz&quot; tabindex=&quot;0&quot; data-language=&quot;bash&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;code&gt;&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-21nrsd&quot;&gt;# Enable catalog-level snapshot expiration&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-1t8gfj&quot;&gt;npx&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; wrangler&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; r2&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; catalog&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; snapshot-expiration&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; enable&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; my-bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; \&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt;  --older-than-days&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; 7&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; \&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt;  --retain-last&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; 10&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;
&lt;p&gt;For more information, refer to the &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;table maintenance documentation&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Wed, 22 Apr 2026 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog now supports automatic snapshot expiration</title><link>https://developers.stormtrust.net/changelog/post/2025-12-18-r2-data-catalog-snapshot-expiration/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2025-12-18-r2-data-catalog-snapshot-expiration/</guid><description>&lt;p&gt;&lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; now supports automatic snapshot expiration for Apache Iceberg tables.&lt;/p&gt;
&lt;p&gt;In Apache Iceberg, a snapshot is metadata that represents the state of a table at a given point in time. Every mutation creates a new snapshot which enable powerful features like time travel queries and rollback capabilities but will accumulate over time.&lt;/p&gt;
&lt;p&gt;Without regular cleanup, these accumulated snapshots can lead to:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Metadata overhead&lt;/li&gt;
&lt;li&gt;Slower table operations&lt;/li&gt;
&lt;li&gt;Increased storage costs.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Snapshot expiration in R2 Data Catalog automatically removes old table snapshots based on your configured retention policy, improving performance and storage costs.&lt;/p&gt;
&lt;figure class=&quot;nb-code-figure&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;pre class=&quot;astro-code astro-code-themes github-light github-dark nb-shiki-c6xiwz&quot; tabindex=&quot;0&quot; data-language=&quot;bash&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;code&gt;&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-21nrsd&quot;&gt;# Enable catalog-level snapshot expiration&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-21nrsd&quot;&gt;# Expire snapshots older than 7 days, always retain at least 10 recent snapshots&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-1t8gfj&quot;&gt;npx&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; wrangler&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; r2&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; catalog&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; snapshot-expiration&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; enable&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; my-bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; \&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt;  --older-than-days&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; 7&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; \&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt;  --retain-last&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; 10&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;
&lt;p&gt;Snapshot expiration uses two parameters to determine which snapshots to remove:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;&lt;code&gt;--older-than-days&lt;/code&gt;: age threshold in days&lt;/li&gt;
&lt;li&gt;&lt;code&gt;--retain-last&lt;/code&gt;: minimum snapshot count to retain&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Both conditions must be met before a snapshot is expired, ensuring you always retain recent snapshots even if they exceed the age threshold.&lt;/p&gt;
&lt;p&gt;This feature complements &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;automatic compaction&lt;/a&gt;, which optimizes query performance by combining small data files into larger ones. Together, these automatic maintenance operations keep your Iceberg tables performant and cost-efficient without manual intervention.&lt;/p&gt;
&lt;p&gt;For more information, refer to &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;Table maintenance&lt;/a&gt; or &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/manage-catalogs/&quot;&gt;Manage catalogs&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Thu, 18 Dec 2025 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog table-level compaction</title><link>https://developers.stormtrust.net/changelog/post/2025-10-06-data-catalog-table-compaction/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2025-10-06-data-catalog-table-compaction/</guid><description>&lt;p&gt;You can now enable compaction for individual &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; tables in &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt;, giving you fine-grained control over different workloads.&lt;/p&gt;
&lt;figure class=&quot;nb-code-figure&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;pre class=&quot;astro-code astro-code-themes github-light github-dark nb-shiki-c6xiwz&quot; tabindex=&quot;0&quot; data-language=&quot;bash&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;code&gt;&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-21nrsd&quot;&gt;# Enable compaction for a specific table (no token required)&lt;/span&gt;&lt;/span&gt;
&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-1t8gfj&quot;&gt;npx&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; wrangler&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; r2&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; catalog&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; compaction&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; enable&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt; &amp;lt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt;BUCKE&lt;/span&gt;&lt;span class=&quot;nb-shiki-140thh&quot;&gt;T&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt;&amp;gt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt; &amp;lt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt;NAMESPAC&lt;/span&gt;&lt;span class=&quot;nb-shiki-140thh&quot;&gt;E&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt;&amp;gt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt; &amp;lt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt;TABL&lt;/span&gt;&lt;span class=&quot;nb-shiki-140thh&quot;&gt;E&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt;&amp;gt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; --target-size&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; 256&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;
&lt;p&gt;This allows you to:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Apply different target file sizes per table&lt;/li&gt;
&lt;li&gt;Disable compaction for specific tables&lt;/li&gt;
&lt;li&gt;Optimize based on table-specific access patterns&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Learn more at &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/manage-catalogs/&quot;&gt;Manage catalogs&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Mon, 06 Oct 2025 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog now supports compaction</title><link>https://developers.stormtrust.net/changelog/post/2025-09-25-data-catalog-compaction/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2025-09-25-data-catalog-compaction/</guid><description>
&lt;p&gt;You can now enable automatic compaction for &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; tables in &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; to improve query performance.&lt;/p&gt;
&lt;p&gt;Compaction is the process of taking a group of small files and combining them into fewer larger files. This is an important maintenance operation as it helps ensure that query performance remains consistent by reducing the number of files that needs to be scanned.&lt;/p&gt;
&lt;p&gt;To enable automatic compaction in R2 Data Catalog, find it under &lt;strong&gt;R2 Data Catalog&lt;/strong&gt; in your R2 bucket settings in the dashboard.&lt;/p&gt;
&lt;img src=&quot;https://developers.stormtrust.net/cdn-cgi/image/onerror=redirect,width=799,height=400,format=webp/_astro/compaction.MLojYuHL.png&quot; alt=&quot;compaction-dash&quot; loading=&quot;lazy&quot; decoding=&quot;async&quot; width=&quot;799&quot; height=&quot;400&quot;&gt;
&lt;p&gt;Or with &lt;a href=&quot;https://developers.stormtrust.net/workers/wrangler/&quot;&gt;Wrangler&lt;/a&gt;, run:&lt;/p&gt;
&lt;figure class=&quot;nb-code-figure&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;pre class=&quot;astro-code astro-code-themes github-light github-dark nb-shiki-c6xiwz&quot; tabindex=&quot;0&quot; data-language=&quot;bash&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;code&gt;&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-1t8gfj&quot;&gt;npx&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; wrangler&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; r2&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; catalog&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; compaction&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; enable&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt; &amp;lt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt;BUCKET_NAM&lt;/span&gt;&lt;span class=&quot;nb-shiki-140thh&quot;&gt;E&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt;&amp;gt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt;  --target-size&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; 128&lt;/span&gt;&lt;span class=&quot;nb-shiki-dzsirb&quot;&gt; --token&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt; &amp;lt;&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt;API_TOKE&lt;/span&gt;&lt;span class=&quot;nb-shiki-140thh&quot;&gt;N&lt;/span&gt;&lt;span class=&quot;nb-shiki-1itgoe&quot;&gt;&amp;gt;&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;
&lt;p&gt;To get started with compaction, check out &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/manage-catalogs/&quot;&gt;manage catalogs&lt;/a&gt;. For best practices and limitations, refer to &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/table-maintenance/&quot;&gt;about compaction&lt;/a&gt;.&lt;/p&gt;</description><pubDate>Thu, 25 Sep 2025 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item><item><title>R2, R2 Data Catalog - R2 Data Catalog is a managed Apache Iceberg data catalog built directly into R2 buckets</title><link>https://developers.stormtrust.net/changelog/post/2025-04-10-r2-data-catalog-beta/</link><guid isPermaLink="true">https://developers.stormtrust.net/changelog/post/2025-04-10-r2-data-catalog-beta/</guid><description>&lt;p&gt;Today, we are launching &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/&quot;&gt;R2 Data Catalog&lt;/a&gt; in open beta, a managed Apache Iceberg catalog built directly into your &lt;a href=&quot;https://developers.stormtrust.net/r2/&quot;&gt;Cloudflare R2&lt;/a&gt; bucket.&lt;/p&gt;
&lt;p&gt;If you are not already familiar with it, &lt;a href=&quot;https://iceberg.apache.org/&quot; target=&quot;_blank&quot; rel=&quot;noopener&quot;&gt;Apache Iceberg&lt;span class=&quot;external-link&quot;&gt; ↗&lt;/span&gt;&lt;/a&gt; is an open table format designed to handle large-scale analytics datasets stored in object storage, offering ACID transactions and schema evolution. R2 Data Catalog exposes a standard Iceberg REST catalog interface, so you can connect engines like &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/spark-scala/&quot;&gt;Spark&lt;/a&gt;, &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/snowflake/&quot;&gt;Snowflake&lt;/a&gt;, and &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/config-examples/pyiceberg/&quot;&gt;PyIceberg&lt;/a&gt; to start querying your tables using the tools you already know.&lt;/p&gt;
&lt;p&gt;To enable a data catalog on your R2 bucket, find &lt;strong&gt;R2 Data Catalog&lt;/strong&gt; in your buckets settings in the dashboard, or run:&lt;/p&gt;
&lt;figure class=&quot;nb-code-figure&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;pre class=&quot;astro-code astro-code-themes github-light github-dark nb-shiki-c6xiwz&quot; tabindex=&quot;0&quot; data-language=&quot;bash&quot; data-nb-lang=&quot;bash&quot;&gt;&lt;code&gt;&lt;span class=&quot;line&quot;&gt;&lt;span class=&quot;nb-shiki-1t8gfj&quot;&gt;npx&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; wrangler&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; r2&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; bucket&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; catalog&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; enable&lt;/span&gt;&lt;span class=&quot;nb-shiki-mdbnqw&quot;&gt; my-bucket&lt;/span&gt;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/figure&gt;
&lt;p&gt;And that&apos;s it. You&apos;ll get a catalog URI and warehouse you can plug into your favorite Iceberg engines.&lt;/p&gt;
&lt;p&gt;Visit our &lt;a href=&quot;https://developers.stormtrust.net/r2-data-catalog/get-started/&quot;&gt;getting started guide&lt;/a&gt; for step-by-step instructions on enabling R2 Data Catalog, creating tables, and running your first queries.&lt;/p&gt;</description><pubDate>Thu, 10 Apr 2025 00:00:00 GMT</pubDate><product>R2</product><category>R2</category><category>R2 Data Catalog</category></item></channel></rss>