Was this page helpful?
Caution
You're viewing documentation for a previous version of ScyllaDB Manual. Switch to the latest stable version.
CDC Streams¶
Streams are partitions in CDC log tables. They are identified by their keys: stream identifiers. When you perform a base table write, ScyllaDB chooses a stream ID for the corresponding CDC log entries based on two things:
in a vnode-based keyspace, the currently operating CDC generation (CDC Stream Changes),
in a tablets-based keyspace, the current stream set associated with the base table,
the base write’s partition key.
Example:
CREATE TABLE ks.t (pk int, ck int, v int, PRIMARY KEY (pk, ck)) WITH cdc = {'enabled': true};
INSERT INTO ks.t (pk,ck,v) values (0,0,0);
INSERT INTO ks.t (pk,ck,v) values (0,1,0);
INSERT INTO ks.t (pk,ck,v) values (0,2,0);
INSERT INTO ks.t (pk,ck,v) values (2,0,0);
INSERT INTO ks.t (pk,ck,v) values (2,1,0);
INSERT INTO ks.t (pk,ck,v) values (2,2,0);
SELECT "cdc$stream_id", pk, ck FROM ks.t_scylla_cdc_log;
returns:
cdc$stream_id | pk | ck
------------------------------------+----+----
0x365fd1a9ae34373954529ac8169dfb93 | 2 | 0
0x365fd1a9ae34373954529ac8169dfb93 | 2 | 1
0x365fd1a9ae34373954529ac8169dfb93 | 2 | 2
0x166eddaa68db9a95af83968998626f7c | 0 | 0
0x166eddaa68db9a95af83968998626f7c | 0 | 1
0x166eddaa68db9a95af83968998626f7c | 0 | 2
(6 rows)
Observe that in the example above, all base writes made to partition 0 were sent to the same stream. The same is true for all base writes made to partition 1.
Mapping Partition Keys to Stream IDs¶
Underneath, ScyllaDB uses the token of the base write’s partition key to decide the stream ID. The method for mapping partition keys to stream IDs depends on whether the keyspace is vnode-based or tablets-based:
Vnode-based Keyspaces¶
ScyllaDB stores a mapping from the token ring (the set of all tokens, which are 64-bit integers) to the set of stream IDs associated with the currently operating CDC generation. Thus, choosing a stream proceeds in two steps:
base partition key |--- partitioner ---> token |--- stream ID mapping ---> stream ID
Therefore, at any given moment, the stream ID chosen for a single base partition key will be the same, but two different partition keys might get mapped to two different stream IDs. But the set of used stream IDs is much smaller than the set of all tokens, so we will often see two base partitions appearing in a single stream:
CREATE TABLE ks.t (pk int, ck int, v int, PRIMARY KEY (pk, ck)) WITH cdc = {'enabled': true};
INSERT INTO ks.t (pk,ck,v) values (2,0,0);
INSERT INTO ks.t (pk,ck,v) values (5,0,0);
SELECT "cdc$stream_id", pk, ck FROM ks.t_scylla_cdc_log;
returns:
cdc$stream_id | pk | ck
------------------------------------+----+----
0x365fd1a9ae34373954529ac8169dfb93 | 2 | 0
0x365fd1a9ae34373954529ac8169dfb93 | 5 | 0
(2 rows)
Note
To make the above example, we simply kept inserting rows with different partition keys until we found two rows that went to the same stream.
Note
For a given stream there is no straightforward way to find a partition key which will get mapped to this stream, because of the partitioner, which uses the murmur3 hash function underneath (the truth is you can efficiently find such a key, as murmur3 is not a cryptographic hash, but it’s not completely obvious).
The set of used stream IDs is independent of the table. It’s a global property of the ScyllaDB cluster:
CREATE TABLE ks.t1 (pk int, ck int, v int, primary key (pk, ck)) WITH cdc = {'enabled':'true'};
CREATE TABLE ks.t2 (pk int, ck int, v int, primary key (pk, ck)) WITH cdc = {'enabled':'true'};
INSERT INTO ks.t1 (pk,ck,v) values (0,0,0);
INSERT INTO ks.t2 (pk,ck,v) values (0,0,0);
SELECT "cdc$stream_id", pk, ck FROM ks.t1_scylla_cdc_log;
returns:
cdc$stream_id | pk | ck
------------------------------------+----+----
0x166eddaa68db9a95af83968998626f7c | 0 | 0
(1 rows)
SELECT "cdc$stream_id", pk, ck FROM ks.t2_scylla_cdc_log;
returns:
cdc$stream_id | pk | ck
------------------------------------+----+----
0x166eddaa68db9a95af83968998626f7c | 0 | 0
(1 rows)
As the example above illustrates, even writes made to two different tables will use the same stream ID for their corresponding CDC log entries if their partition keys are the same, assuming that the operating CDC generation doesn’t change in between those writes.
More generally, two base writes will use the same stream IDs if the tokens of their partition keys get mapped to the same stream ID by the CDC generation.
Tablets-based Keyspaces¶
In a tablets-based keyspace, each base table has its own set of streams operating at any given moment. The stream ID is chosen based on the base write’s partition key and the currently operating stream set of the base table.
Similarly to vnode-based keyspaces, writes to a single partition key in a given table will be mapped to the same stream ID, unless the stream set changes. Writes to different partition keys in one table may be mapped to different stream IDs, or they may be mapped to the same stream ID.
However, writes made to different tables will always be mapped to different stream IDs, because each table has its own distinct set of streams.
Ordering¶
All considerations related to partition and clustering keys apply to CDC log tables. In particular, when performing a partition scan of the CDC log table, all entries from one stream will appear before all entries from another:
CREATE TABLE ks.t (pk int, ck int, v int, PRIMARY KEY (pk, ck)) WITH cdc = {'enabled':'true'};
INSERT INTO ks.t (pk,ck,v) values (0,0,0);
INSERT INTO ks.t (pk,ck,v) values (2,0,0);
INSERT INTO ks.t (pk,ck,v) values (0,1,0);
INSERT INTO ks.t (pk,ck,v) values (2,1,0);
INSERT INTO ks.t (pk,ck,v) values (0,2,0);
INSERT INTO ks.t (pk,ck,v) values (2,2,0);
SELECT "cdc$stream_id", totimestamp("cdc$time"), pk, ck FROM ks.t_scylla_cdc_log;
returns:
cdc$stream_id | system.totimestamp(cdc$time) | pk | ck
------------------------------------+---------------------------------+----+----
0x365fd1a9ae34373954529ac8169dfb93 | 2020-03-25 13:12:59.195000+0000 | 2 | 0
0x365fd1a9ae34373954529ac8169dfb93 | 2020-03-25 13:12:59.196000+0000 | 2 | 1
0x365fd1a9ae34373954529ac8169dfb93 | 2020-03-25 13:12:59.197000+0000 | 2 | 2
0x166eddaa68db9a95af83968998626f7c | 2020-03-25 13:12:59.194000+0000 | 0 | 0
0x166eddaa68db9a95af83968998626f7c | 2020-03-25 13:12:59.195000+0000 | 0 | 1
0x166eddaa68db9a95af83968998626f7c | 2020-03-25 13:12:59.197000+0000 | 0 | 2
(6 rows)
Therefore, there is no global time ordering between all writes in the CDC log; you only get time-based ordering within a stream, for each stream.