Storing Cymbal Retail’s data
1. Storing Cymbal Retail’s data
Let’s begin by exploring the role of a Professional Data Engineer in storing data in Google Cloud for Cymbal Retail, including data architecture, database selection, and data lifecycle management. As a Professional Data Engineer, you role is deeply intertwined with how Cymbal Retail uses data. Cymbal Retail ingests, stores, processes, and analyzes many types of data, including documents, images, text, and video. There are close to a thousand databases used across the organization containing structured and unstructured data. Google Cloud has a variety of databases, both SQL and NoSQL, and also products suitable for data lakes, data warehouses, and data meshes. You need to know the difference between each of them and choose the appropriate storage solution, which is essential to ensuring efficiency of access and cost. All of this data, running into petabytes, has to meet the multi-modal purpose of cost-efficient storage, quick retrieval for analytics, and secure access. To comply with industry and regional data privacy laws, Cymbal Retail needs to have clear and demonstrable governance controls in place. Your data engineering team must ensure that data follows a well-defined lifecycle. Each region's laws define a strict timeline for the retention and deletion of customer data. You need to set controls in place so that individuals do not accidentally breach rules. It is also your responsibility as a Professional Data Engineer to continue to maintain Cymbal Retail’s data for effective use. As business requirements change, you need to evolve the data architecture to meet demand. Appreciation of the goals of the business and the ability to map them to data decisions make an excellent data engineer.2. Let's practice!
Create Your Free Account
or
By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.