Maintaining and automating data workloads at Cymbal Retail
1. Maintaining and automating data workloads at Cymbal Retail
Let’s begin by exploring the role of a Professional Data Engineer in helping Cymbal Retail maintain and automate its data workloads. As part of the Data Engineering team at Cymbal Retail you are responsible for ensuring cost effectiveness and correctness of data. The team has understood that automation and observability are cornerstones to providing a reliable and scalable service to end customers, internal teams, and to vendors. You need to be familiar with monitoring and managing active workloads to balance compute capacity, error handling, and costs. Cost control, though extremely important, cannot be detrimental to the end user experience. Web pages and purchase workflows have to be fast and frictionless. Availability has to be high, as a customer who has even a one-time bad experience is a customer lost. In order to balance the competing demands of user experience and cost-efficiency, you need to research and obtain the best pricing available from Google Cloud. To help achieve both reliability and cost control, Cymbal Retail wants to automate workloads and scale repeatable data processing. As a Professional Data Engineer, you need to regularly look for opportunities to optimize through automation and to boost efficiency. Taking a hands off approach to maintenance with appropriately set notifications and thresholds can save considerable time and effort while achieving scale. Marketing and sales teams need the flexibility to run campaigns quickly. These deals could bring in big spikes in demand for a short period, which results in valuable sales. Previously the marketing and sales teams would inform the data engineering team of such events weeks or months in advance, which would help them arrange the required computing and data resources. This has been found to be prohibitive. You need to find solutions that give considerable autonomy and independence to the marketing and sales teams to run their campaigns without being restricted by the technology demands.2. Let's practice!
Create Your Free Account
or
By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.