Artifact Building
1. Artifact Building
person: In this section we'll review artifact building. Specifically, we'll cover how we should package Apache Beam with the rest of our pipeline artifacts. Apache Beam uses semantic versioning. Version numbers use the form major dot minor dot incremental and are incremented as follows. Major versions are incremented for incompatible API changes. Minor versions are incremented for new functionality added in a backward incompatible manner. Finally, the incremental version is incremented for forward compatible bug fixes. Build artifacts necessary for your Java pipelines are available on Maven Central. There are lots of packages available for beam and you'll usually need more than just the core. The build system has Maven or Gradle. Here we're showing snippets of a Maven palm. It's typical that you'll need to pull in more than just the core. Notice here that we're pulling in other dependencies for the Dataflow runner and for GCP IOs. We recommend that you use beam 2.26 and higher Versions from 2.226 use the Google Cloud libraries bomb to specify Google related library versions which reduce the potential for dependency conflicts.2. Let's practice!
Create Your Free Account
or
By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.