Grandes players em computação em nuvem

Você viu alguns exemplos de provedores de serviços em nuvem. Aprendeu sobre os três maiores, que juntos detinham mais de 50% de participação de mercado em 2018. Eles tinham 32%, 17% e 10% do mercado.

Consegue ordenar corretamente os três maiores?

Este exercício faz parte do curso

Introdução à Engenharia de Dados

Exercício interativo prático

Transforme a teoria em ação com um de nossos exercícios interativos

Começar o exercício

Este exercício faz parte do curso

Introdução à Engenharia de Dados

IntermediárioNível de habilidade

4.8+

Iniciar curso de graça

In this first chapter, you will be exposed to the world of data engineering! Explore the differences between a data engineer and a data scientist, get an overview of the various tools data engineers use and expand your understanding of how cloud technology plays a role in data engineering.

Exercise 1: O que é engenharia de dados?Exercise 2: Tarefas do data engineer Exercise 3: Data engineer ou data scientist?Exercise 4: Problemas de engenharia de dados Exercise 5: Ferramentas do engenheiro de dados Exercise 6: Tipos de bancos de dados Exercise 7: Tarefas de processamento Exercise 8: Ferramentas de agendamento Exercise 9: Provedores de nuvem Exercise 10: Por que computação em nuvem?Exercise 11: Grandes players em computação em nuvem

Exercício atual

Exercise 12: Serviços em nuvem

Now that you know the primary differences between a data engineer and a data scientist, get ready to explore the data engineer's toolbox! Learn in detail about different types of databases data engineers use, how parallel computing is a cornerstone of the data engineer's toolkit, and how to schedule data processing jobs using scheduling frameworks.

Exercise 1: Databases Exercise 2: SQL vs NoSQL Exercise 3: The database schema Exercise 4: Joining on relations Exercise 5: Star schema diagram Exercise 6: What is parallel computing Exercise 7: Why parallel computing?Exercise 8: From task to subtasks Exercise 9: Using a DataFrame Exercise 10: Parallel computation frameworks Exercise 11: Spark, Hadoop and Hive Exercise 12: A PySpark groupby Exercise 13: Running PySpark files Exercise 14: Workflow scheduling frameworks Exercise 15: Airflow, Luigi and cron Exercise 16: Airflow DAGs

Having been exposed to the toolbox of data engineers, it's now time to jump into the bread and butter of a data engineer's workflow! With ETL, you will learn how to extract raw data from various sources, transform this raw data into actionable insights, and load it into relevant databases ready for consumption!

Exercise 1: Extract Exercise 2: Data sources Exercise 3: Fetch from an API Exercise 4: Read from a database Exercise 5: Transform Exercise 6: Splitting the rental rate Exercise 7: Prepare for transformations Exercise 8: Joining with ratings Exercise 9: Loading Exercise 10: OLAP or OLTP Exercise 11: Writing to a file Exercise 12: Load into Postgres Exercise 13: Putting it all together Exercise 14: Defining a DAG Exercise 15: Setting up Airflow Exercise 16: Interpreting the DAG

Cap off all that you've learned in the previous three chapters by completing a real-world data engineering use case from DataCamp! You will perform and schedule an ETL process that transforms raw course rating data, into actionable course recommendations for DataCamp students!

Exercise 1: Course ratings Exercise 2: Exploring the schema Exercise 3: Querying the table Exercise 4: Average rating per course Exercise 5: From ratings to recommendations Exercise 6: Filter out corrupt data Exercise 7: Using the recommender transformation Exercise 8: Scheduling daily jobs Exercise 9: The target table Exercise 10: Defining the DAG Exercise 11: Enable the DAG Exercise 12: Querying the recommendations Exercise 13: Congratulations