Topic Category: Theory / Concept

To learn more about strategies that can accelerate neural network training, watch the 6-minute video below. You can follow along with the instructor’s presentation using the slides available here. The additional resources that were mentioned during the presentation are linked below. Take some time to look them over. What's the Difference Between a CPU and a …

Topic 6: accelerating neural network training Read More »

The 12-minute video below will cover the difference between underfitting and overfitting, and then discuss the most common methods for combatting overfitting in neural networks. To follow along with Jon-Cody’s presentation, download the slides available here. If that video raised any questions for you, post them to the course forum. Otherwise, spend some time reviewing the …

Topic 3: assessing and improving the fit Read More »

We start Lesson 3 with a 22-minute video on loss functions and model performance metrics. To follow along with Jon-Cody's presentation, download the slides available here. For easy reference, here is the chart Jon-Cody used to explain when to use the various loss functions: Now, don't forget to spend some time reviewing the descriptions of …

Topic 1: loss functions and model performance Read More »

Watch the 7-minute video that follows for an overview of batch size and epochs and why they are used. You can follow along with the instructor's presentation using the slides available here. Topics 6 and 7 will begin to explore how a model changes when these parameters are adjusted. But before you move on to …

Topic 5: batch size and number of epochs Read More »

Watch the 7-minute video below to better understand optimizers and learning rate. The presentation is available for download here. The tf.keras optimizer documentation, discussed at slide 5, can be found here. Take a moment to explore it before moving on to the quiz.

In the Topic 3 video, Jon-Cody will spend 9 minutes explaining activation functions in more depth and describing several common ones. His presentation is available for download here. Before moving on, take some time to explore the documentation for tf.keras activation functions that was mentioned during the discussion on slide 2, and do some additional …

Topic 3: activation functions Read More »

We start Lesson 2 with an 11-minute video to explain the logic behind neural networks in a bit more depth that we've covered previously. You can follow along with this presentation using the slides available here. Need some inspiration? Take a minute to play and explore Quick, Draw!, a game in which a neural network …

Topic 1: neural network logic Read More »

This topic begins with a 9-minute video from your instructor that covers defining, compiling, and fitting a model. You can follow along with his presentation using the slides available here. Now, before moving on to the quiz, take some time to explore the additional resources that were mentioned during the presentation: Package documentation for tf.keras.Sequential …

Topic 4: defining, compiling, and fitting a model Read More »

For an overview of the different layers of the neural network, watch the 6-minute video below. You can follow along with the instructor's presentation using the slides available here. Want to read more on the topic? Check out the blog post by David Fumo entitled A Gentle Introduction to Neural Networks Series - Part 1. …

Topic 2: the layers of a neural network Read More »