Topic Category: Theory / Concept

Topic 6: accelerating neural network training

To learn more about strategies that can accelerate neural network training, watch the 6-minute video below. You can follow along with the instructor’s presentation using the slides available here. The additional resources that were mentioned during the presentation are linked below. Take some time to look them over. What's the Difference Between a CPU and a... Read more »

Topic 3: assessing and improving the fit

The 12-minute video below will cover the difference between underfitting and overfitting, and then discuss the most common methods for combatting overfitting in neural networks. To follow along with Jon-Cody’s presentation, download the slides available here. If that video raised any questions for you, post them to the course forum. Otherwise, spend some time reviewing the... Read more »

Topic 1: loss functions and model performance

We start Lesson 3 with a 22-minute video on loss functions and model performance metrics. To follow along with Jon-Cody's presentation, download the slides available here. For easy reference, here is the chart Jon-Cody used to explain when to use the various loss functions: Now, don't forget to spend some time reviewing the descriptions of... Read more »

Topic 5: batch size and number of epochs

Watch the 7-minute video that follows for an overview of batch size and epochs and why they are used. You can follow along with the instructor's presentation using the slides available here. Topics 6 and 7 will begin to explore how a model changes when these parameters are adjusted. But before you move on to... Read more »

Topic 4: optimizer and learning rate

Watch the 7-minute video below to better understand optimizers and learning rate. The presentation is available for download here. The tf.keras optimizer documentation, discussed at slide 5, can be found here. Take a moment to explore it before moving on to the quiz.

Topic 3: activation functions

In the Topic 3 video, Jon-Cody will spend 9 minutes explaining activation functions in more depth and describing several common ones. His presentation is available for download here. Before moving on, take some time to explore the documentation for tf.keras activation functions that was mentioned during the discussion on slide 2, and do some additional... Read more »

Topic 1: neural network logic

We start Lesson 2 with an 11-minute video to explain the logic behind neural networks in a bit more depth that we've covered previously. You can follow along with this presentation using the slides available here. Need some inspiration? Take a minute to play and explore Quick, Draw!, a game in which a neural network... Read more »

Topic 4: defining, compiling, and fitting a model

This topic begins with a 9-minute video from your instructor that covers defining, compiling, and fitting a model. You can follow along with his presentation using the slides available here. Now, before moving on to the quiz, take some time to explore the additional resources that were mentioned during the presentation: Package documentation for tf.keras.Sequential... Read more »

Topic 3: TensorFlow basics

Now that you know a little bit more about neural networks, let's dig in to TensorFlow. In the 9-minute video below, your instructor will cover the basics. To follow along with him, the presentation materials for this topic available for download here. The additional resources that were mentioned during the presentation are linked below. Take... Read more »

Topic 2: the layers of a neural network

For an overview of the different layers of the neural network, watch the 6-minute video below. You can follow along with the instructor's presentation using the slides available here. Want to read more on the topic? Check out the blog post by David Fumo entitled A Gentle Introduction to Neural Networks Series - Part 1.... Read more »