Showing posts with label data analysis. Show all posts
Showing posts with label data analysis. Show all posts

Tuesday, May 10, 2011

Data analysis – the good and the bad

Last 2 weeks in April were crazy for me with finals and term paper submissions and assignments and trying to wind up experiments. As far as research was concerned (my 2nd rotation in an awesome lab), I was able to stick to the plan I made - did all the experiments that I had to and was left with data analysis in the last few days. Yes, the other side of things. Getting experiments to work is just the first half of the story; trying to make (any) sense of the data you get out of experiments is the other half.

It was only after I plunged into this other half, did I realize how much of data I generated that it felt close to impossible to analyse all of it before my big day – when I’d be presenting in the lab meeting. I was beginning to wonder which is the tougher one that makes you go crazy – the experiments or the data analysis. It really tires you out. Though I got through everything and even got some interesting results, I still don’t have an answer to that question (which I think is a profound one).

But I did learn a couple of things about this whole process of studying data. The most important thing being - never leave this task to the end. Never. The best way to go about it is to start getting a hang of how the data looks as and when you have some of it ready. In my case, each time I did an experiment I took a good number of movies so I could have a good number of data points but once I started analysing the movies, I realized that they were not enough. I needed so many more movies. This happens when you are studying motors in invitro assays (which was what I was studying). There were also some data sets where I felt I’d be better off with a longer movie, maybe slower/faster frame rate and such things. Its always good to know what are the things you need to work on before you do the experiment again at a later point.

Another important aspect – honesty. Since I sort of knew what kind of a trend or pattern I should see in the parameters that I was studying across several different experiments, each time I got to a point where I was able to compare these cases, my mind would try to work its way and make sure I was seeing exactly the expected trend. I found it slightly hard in the beginning to do a completely unbiased analysis. But I got around this by telling myself that what people have seen in the past need not be true at all and maybe I’d see something novel (well, I know this is not true in most cases but you get what I mean, atleast it motivated me to do a blindfold analysis). Its very important to be completely honest with yourself and be able to communicate to others how exactly you went about analysing your data. That way me giving a talk in the lab meeting was good – I realized each person has a different style of looking at his/her data and even representing it. I think that’s one of the things that has to be given a good thought – what is the one best way to represent your data that will definitely make people think and not just listen.

All said, I’m glad I learnt these small things early on. Also, just so you know my talk went very well and the rotation was extremely satisfying :)

PS: About the title - I don't think there's an ugly side to data analysis, is there?