Explore and Prepare Data

1. Explore and Prepare Data

let's begin with data exploration and preparation starting a new project is exciting but data exploration can be challenging often feel like a detective with a mountain of Clues but no clear Direction let's see how Gemini and big query can help Gemini powered tools like insights and table Explorer unlock valuable discoveries from data even for non-technical users with no coding experience insights automatically create queries from table metadata making data exploration a breeze here's how it works analyze metadata insights first scans your tables metadata like column names and descriptions to grasp the data's Essence generate queries inspired by this metadata insights then creates a list of helpful queries tailored to your tables these ready to use queries hold the key to unveil the hidden patterns explore and refine you dive into these queries and modify them as needed run and analyze you run the query analyze the results and uncover the insights cool how about table Explorer table Explorer is your visual tool to explore individual tables here's the process select Fields you can choose up to 10 fields in a table to focus on generate interactive cards table Explorer then generates interactive cards which show the most common values to give you a quick overview explore and filter you can click on values to drill down for more specific results create queries table Explorer automatically creates a query based on your actions apply you can apply the query directly or copy it to the query editor for further customization and execution think of both insights and table Explorer as tour guides of your data to help you with a cold start navigate through mountains of information and discover hidden patterns and paths amazing this also opens a door for non-technical users like B and her team equipped with the tools they often get deeper insights from the data than we do by leveraging their field expertise aside from the advantages are there any precautions I should take when using these tools excellent question remember that both tools are limited to working with single tables at a time this means for now they are not capable of performing ing complex operations such as joining multiple tables together well that's a great start the next real challenge lies in data preparation it's a timeconsuming and often tedious task that eats up over 60% of my time like many other data practitioners can't agree more big query uses Gemini to build low code visual AI augmented data preparations let's check out how it can be used for data cleaning and pipeline development for for data cleaning and transformation Gemini and big query provides two options first it automatically generates suggestions on the sidebar for tasks like filtering standardizing and fixing missing data you can directly apply the code if desired second you can direct Gemini to perform certain tasks by using natural language prompts for example ask Gemini to remove duplicate rows or convert data to a specific format how about automating a data pipeline Gemini in big query dramatically enhances ETL extract transform load it uses generative Ai and ml to Define Transformations it also ensures data quality with rule-based logic and anomaly detection plus it visualizes the data pipeline as a graph making it easy to understand the preparation process this speeds up the ETL development workflow in this demo let's see how insights and table Explorer in big query can help you explore data let's say you're curious about the order data start by clicking on the table then select insights and generate insights it might take a few minutes for big query to scan the metadata and create insights once it's done you'll have a list of query questions tailored to this table want to find out most popular menu items by quantity sold check out this automatically generated query code feel free to give it a try by clicking copy to query and then run here are the results want to rank the top three items however don't know how to code no worries just ask Gemini to do it for you type in the hashtag sign followed by a simple prompt find top three items accept the code and run it that's it you can bring the tab over to the left pane for a better view feel free to go through all these autogenerated insights explain them run them and modify them to your needs now let's check out the other tool table Explorer this one helps you dive deeper into each table let's say you're interested in the location table click on the table then select table Explorer and choose the fields you want once you save it you'll get an interactive card for each field showing the most common values if you're interested in certain values choose them and big query will automatically generate the query code for for you then you can run and modify the code as needed this is just a quick overview of the major features of insights and table Explorer feel free to explore more on your own cool can I try it myself absolutely here's a Hands-On lab for you to explore tools like insights and table Explorer hey Diane up for a quick quiz before the lab hit me with it what does insights do in big query a automatically generates queries to explore data B visualizes the relationships between tables C automatically transforms the data format or D generates interactive cards for each table H I think it's a you got it how can I use the help of Gemini in big query to write code and solve more complex tasks let's tackle that topic in the next lesson

2. Let's practice!

Create Your Free Account

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.