Day 20

I finished my classifier experiment today. The only classifier I had left to test was the SNN (Self-Normalizing Neural Network). I had it narrowed down to two combinations of parameters, so I decided to run thirty trials on each of them and see which one performed better. I got to the lab early today, so I started running those and went to the morning meeting. At the meeting, we each described where we were in our projects and said how prepared we were for the presentation. My PowerPoint was about half done and I said I was just finishing my second experiment (the classifiers experiment). After I got back to the lab, the tests I was running crashed because the network connection was lost, so I had to restart them. That was a bummer. When I finally finished those tests, I added the results from the best parameters to my results table. After that, I began my next experiment, which should take less time than my previous experiments. It is to evaluate postprocessing methods. I already had most of the code for that set up, so I finished and started running it. For most of my time in the lab today, I was working on my PowerPoint presentation. I am pretty much done with the slides, but I still have to add the results from the postprocessing experiment and probably make some edits later. I collected the results the trials with no postprocessing and with the MRF (Markov Random Field) postprocessor, but the CRF postprocessor is taking a very long time, so I might not get those results until tomorrow.

Also, the following image is what my everyday work looks like. I was going to use this image in my presentation, but I did not find a good place to include it, so I will just show it here.

Comments

Post a Comment

Popular posts from this blog

Day 5

I began the first experiment of my project today. But first, I prepared by doing some reading on the topic of hyperspectral image classification. I read a paper written by Ron and Dr. Kanan about self-taught feature learning. It discussed two self-taught learning frameworks: the multiscale ICA and the stacked convolutional autoencoder. Much of it was difficult for me to understand because I am new to this topic, but I learned more about self-taught machine learning programs. After I finished reading, I began my first experiment. The first step was to document already written machine learning code and to figure out what that code was doing. I read about the standard Python documentation style, then I began to document the code. This proved to be challenging, because this code implemented many methods from outside of itself, which meant I had to understand those methods as well. Today I learned that understanding and following code that was written by someone else can be just as challeng
Read more

Day 13

Today I continued tests for my classifier experiment. I worked on finding the optimal parameters for the Multi-Layer Perceptron (MLP) classifier. I was trying to determine the best hidden layer shape and weight decay. Hidden layer shape is how many dimensions (layers) of neurons (nodes used for machine learning) there are, and how many neurons are in each dimension. I only began with the knowledge that there would be a maximum of three layers in the hidden layer shape. Weight decay is a value that decreases the weight values after each training iteration to prevent overfitting to the training data. I knew that the best value for weight decay would be 1e-4, 5e-4, or 0. I wrote a program to test different combinations of hidden layer shapes and weight decay values. While these tests were running, I documented some of the classifiers with which I was working, including the MLP classifier. This process helped me to better understand MLP and the other classifiers because it made me work thr
Read more

Day 7

Today, I started by writing my abstract, which is a short summary of the project on which I am working this summer. (The abstract is included in my last post.) To write my abstract, I needed to develop a clear idea of my project. I found that summarizing it in writing actually helped me to better understand what I am doing as a whole. After completing and posting my abstract, I returned to my experiment. I first set out to solve the problem of incorrect dimensions in my data, which I had run into on the previous day. I took out the code that reshaped the data, because the data had to be in their original dimensions for the preprocessing methods to function correctly. However, this meant that I had to rewrite the code that split the data by labels into training and testing categories. I had to use an entirely different strategy than I had been using before. Instead of directly splitting the data into two arrays, I am now creating an array of the indices of the data values in the origina
Read more