Day 10

Today I finished running trials on the remaining two preprocessing methods. I recorded the means and standard deviations of the three metrics of each preprocessing method in a chart. Also, for one of the methods, called "PCA" or Principal Component Analysis, Ron had me begin a separate experiment: I was to find the mean-class accuracy when using PCA with different numbers of components. I would do this first using PCA with whitening, which is a linear data transformation, and then without whitening, and compare the two groups of results. I added to my code so that it could run thirty trials with each number of components I was to test. I had to make adjustments in my code for PCA because it is used differently than the other preprocessing methods I am testing. I began to run the trials on PCA with each number of components (of which I am testing eleven). I ran trials and recorded the results from using PCA with whitening with nine different numbers of components today. I plan to either run the remainder with whitening and all of those without whitening either overnight or tomorrow. Also, during lunch today I went to a presentation about studying young stars through telescope imaging. I learned about how scientists use image data to determine the distance of stars and the substances of which they are made.

Comments

Post a Comment

Popular posts from this blog

Day 19

My birthday is today, so I am now seventeen. I started today by adding the data from the Random Forest tests of yesterday to my results table. I decided to use the data from the test with StandardScaler as the preprocessor. After that, I began testing the SNN (Self-Normalizing Neural Network) classifier. I already knew that I had to use StandardScaler for it, but I needed to figure out what values to use for the layer size, which is how many machine learning "neurons" are in each layer of the SNN. I also needed to figure out some other parameters, so I did a lot of parameter tests on SNN today and recorded a lot of data, most of which I will not need after today. I was finding the best parameters with which to test SNN. While those tests were running, I began working on a PowerPoint for my presentation. I tried to make sure that I explained everything in my presentation so that anyone in the audience, even if they have absolutely no experience with the topic, will be able to ...
Read more

Day 18

When I began today, I had all of my writing so far done, which meant I did not have anything on which to work while my classifier experiment code ran, so Ron introduced me to my next experiment, which is evaluating postprocessing methods. I started by documenting the already-written code for the postprocessors, which were a Markov Random Field (MRF) and a Conditional Random Field (CRF). It remains a challenge for me to document code written by others. I usually document code that I write when I am writing it so that I do not have to go back to it and try to figure out what it does. After I finished documenting the two postprocessors, I began writing the code for my postprocessor experiment, but I will likely have to alter it later because I do not yet know which classifier is the most accurate, because my classifier experiment is not over yet. For now I have the postprocessing code use the SVM-RBF classifier, which is the best one so far. Finally my trials on the MLP classifier with th...
Read more

Day 6

I began today by finishing the documentation I had been doing of the code for my experiment. After that, I began working on new code that would test the performance of data preprocessing methods that were already written. I am using the Pavia University scene, which is a set of labeled hyperspectral data. I began to write code to run the experiment, which will include testing various preprocessing methods each with thirty trials. In the process, I used the code from my first tutorial as a reference, and I found an error in that code that had been making it run too slowly. It had been using too much data to train. I fixed this issue, making that code run more quickly, and continued with the code for my experiment. Eventually, in my experiment code, I ran into a problem: I was shaping the data into different dimensions to split it into training and testing groups, but it had to be in its original dimensions to be used by the preprocessing methods. I am still working on this issue, and I ...
Read more