OpenAI provides models that go far beyond text generation. In this chapter, you'll use OpenAI's text-to-speech and text-to-speech audio models. You'll also moderate user content to detect misuse.

Speech-to-text

Creating a podcast transcript

Transcribing a non-English language

Translating Portuguese

Text-to-speech (TTS)

OpenAI's text-to-speech (TTS)

TTS in other languages!

Content moderation

Options

OpenAI's Moderation model

Keyword Pattern Matching

Manual Moderation

Why use text moderation models?

Requesting moderation

Examining moderation category scores

Beyond Text Generation

You'll build a fully functional, end-to-end AI-powered chatbot! This chatbot will accept and respond to customer queries as voice messages, even responding in non-English languages!

Creating customer call transcripts

Transcribing customer calls

Deriving the customer's language

Translating the transcript into English

Fixing translation mistakes

Generating a customer response

Moderating the customer call

Generating a tailored response

Moderating the model response

Creating a speech response for customers

Response translation

Preparing the spoken response

Congratulations!

 Case Study: Building a Customer Support Chatbot

Bored of text generation yet? If so, you've come to the right course! OpenAI provides models far beyond text generation. In this course, you'll learn how to use OpenAI's speech-to-text and text-to-speech models, and also perform content moderation to detect inappropriate content. You'll wrap up the course with a case study where you'll build your own end-to-end smooth-talking customer support chatbot that can respond to customer inquiries with spoken audio in their native language!

<h2>Develop Multi-Modal Applications with the OpenAI API</h2>To build applications that are accessible to as wide an audience as possible, it's important that they can accept inputs in different modalities, like text and speech. In this course, you'll build on your knowledge of OpenAI's text generation models and learn to master their audio models!<br><br><h2>Master Audio Applications</h2>Did you know OpenAI developed audio models? In this course, you'll learn to create reliable text transcripts in multiple languages using their speech-to-text models. You'll also flip the script and generate realistic human audio (and in multiple languages!) with their text-to-speech models.<br><br><h2>Protect and Moderate AI Applications</h2>AI applications are often designed for a very specific reason, but a malicious actor may try to misuse it in different ways. In this course, you'll utilize OpenAI's moderation models to detect inappropriate user and AI-generated content.<br><br><h2>Build Functional Customer Chatbots</h2>You'll complete a case study to create an end-to-end customer service chatbot that will receive customer queries, and use internal resources to respond back to the customer. Not only that, it will respond in their native language and with AI-generated spoken audio!

Working with the OpenAI API

Create multi-modal systems using OpenAI's text and audio models, including an end-to-end customer support chatbot!

Multi-Modal Systems with the OpenAI API

OpenAI Grundlagen

TTS in other languages!

Multi-Modal Systems with the OpenAI API

Anleitung zur Übung

Interaktive Übung