BigtableIO
1. BigtableIO
Bigtable is a scalable, NoSQL database service by Google. Both Bigtable and Dataflow are designed for high throughput and scalability. BigtableIO serves as the module that will communicate between Bigtable and Dataflow. You are able to include a row filter when reading from Bigtable. This allows you to filter out rows based on criteria. You can invoke this with the withRowFilter clause and passing the filter criteria. Another important aspect of NoSQL databases is the ability to use the index. withKeyRange will allow you to enable a prefix scan on the index to quickly arrive at the desired prefix. There are times where you will want to continue on a pipeline after a sink rate has completed. BigtableIO has this ability by triggering the Wait.on function in Beam by sending a signal to the Wait function. This enables you to continue with an additional transformation after a write has completed.2. Let's practice!
Create Your Free Account
or
By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.