This Jupyter notebook can be found on my GitHub page (located at: https://github.com/djsaunde/GRiD/data_processing_tutorial). It appears that some of the images which I attempted to display will not, due to some WordPress issues. You may click on the link to the images which do not display to view them outside of this blog post. Introduction Python … Continue reading Data Processing in Python Using Pandas and Matplotlib

# The Bias-Variance Tradeoff

To avoid extremely long and redundant blog posts, instead of writing notes on an entire chapter from Deep Learning, I will instead write about a chapter subsection or some topic I find interesting. Today's post is about the bias-variance tradeoff, a well-known problem in machine learning which involves minimizing two sources of error which prevent supervised learning … Continue reading The Bias-Variance Tradeoff

# Deep Learning Book: Probability and Information Theory

Thus begins my notes on the third chapter of Deep Learning, entitled Probability and Information Theory. This chapter was more exciting to read than the last, but there is a similar amount of math notation. Like the last chapter, it contains mathematics and ideas which are fundamental to the practice of deep learning. P.S. This took way too … Continue reading Deep Learning Book: Probability and Information Theory

# brian2 Spiking Neural Network Simulator Tutorial

I want to get familiar with the brian2 spiking neural network simulator; hence, this blog post. The code and Markdown-formatted comments were developed in a Jupyter notebook. Part I: Neurons Imports and Setup brian2 has a system for using quantities with physical dimensions. All the basic SI units can be used along with their standard prefixes, and … Continue reading brian2 Spiking Neural Network Simulator Tutorial

# Word2vec: A Computationally Efficient Model for Learning Word Embeddings

word2vec: Tensorflow Tutorial In which I walk through a tutorial on building the word2vec model by Mikolov et al. I'll document justification for the code I write each step of the way. Much of the notes / images / code are / is copied or slightly altered from the tutorial. Imports Highlights This Tensorflow tutorial … Continue reading Word2vec: A Computationally Efficient Model for Learning Word Embeddings

# Deep Learning Book: Linear Algebra

Okay, so this chapter certainly isn’t the most glamorous, but understanding its content will be a crucial step in motivating the mathematical fundamentals of machine learning or deep learning model and algorithms. Chapter 2: Linear Algebra Linear algebra is a branch of mathematics which is often applied in various science and engineering disciplines. Since linear algebra […]

# Handwritten Digits Recognition with Convolutional Neural Networks

Yesterday, I built a convolutional neural network model to recognize handwritten digits (0-9) as part of a Kaggle competition. I borrowed heavily from this kernel, but cleaned up the code and wrote better documentation. Here's the code, written variously in Markdown and Python in a Jupyter notebook. To run the code, you'll need Python 2.x, … Continue reading Handwritten Digits Recognition with Convolutional Neural Networks

# Thoughts on Completing an Undergraduate Program and Beginning Graduate School

I graduated this past fall from UMass Amherst with two bachelor's degrees: one in computer science, and another in mathematics. I decided to take an extra semester, for a total of four and a half years, to (1) load up on some advanced undergraduate courses, (2) get a head start on graduate coursework, (3) start … Continue reading Thoughts on Completing an Undergraduate Program and Beginning Graduate School

# Deep Learning Book: Introduction

As part of my goals for the new year, I've decided to create a blog post for each chapter in the new Deep Learning textbook after I read it. I'm really excited to read this book, and am somewhat star-struck by its authors (Ian Goodfellow, Yoshua Bengio, Aaron Courville), who are preeminent researchers in the deep learning field. I … Continue reading Deep Learning Book: Introduction

# Turing B-Type Machines, Reservoir Computation, Memristors, and Super-Turing Computation

Below is a summary of some concepts I have been discussing with my adviser during this semester. I wrote this very quickly (in the space of about 45 minutes), and meant this to be a quick-and-dirty reference for a meeting we had this morning. I made a few edits before posting. Why am I posting this? … Continue reading Turing B-Type Machines, Reservoir Computation, Memristors, and Super-Turing Computation