I recently made the transition from academia to industry. Some people were surprised I decided to leave - I had had a pretty successful academic career. So why did I want to leave? I've read a lot of articles and opinions on reasons people leave academia. The common reasons I often saw people cite for why they decided to leave didn't resonate with me. It's usually things like that the academic job market is too tough, or that industry pays better. The better pay is certainly nice, but that wasn't an impetus for my switch. I had never really worried about the job market. So why did I decide to leave?

Becoming unhappy in academia

I was pretty happy during my PhD. I learned a lot throughout it, got a lot of positive feedback, felt respected, and interacted with my peers a lot. Even so, by my last year, and especially after starting my postdoc, I was slowly becoming less satisfied. Eventually I was just not happy. I became stressed out, and research wasn't fun anymore.

One day I was describing my work environment to my roommate who works in industry. I told him I had maybe one to three meetings with people throughout the week. I explained that during my day, I mostly was by myself in an office. He said that sounded like it really sucked. That off-hand comment was actually really eye-opening to me. It had never occurred to me that working in such isolation probably wasn't good for me. It seemed just like the natural process of becoming more independent would of course mean more isolation.

As a postdoc or a grad student, it would often just be me and my advisor on a project. If my advisor was busy (frequently the case), it meant I was alone on the project. If others were involved in the project, in my experience their involvement was pretty superficial and communications usually occurred via email, or meetings once every month or two. It really didn't feel like I had anyone 'with me' on solving issues on a project, which was stressful. More importantly, I felt lonely.

Talking to other friends in industry reinforced the impression that it was much less isolating to work in industry than in research. They talked about frequent code-reviews and stand-up meetings. Since project turn-around was much quicker, project meetings were much more frequent. There was always a lot of interaction going on.

Few reasons to stay

After I had pinpointed why I was feeling so unhappy, I did a lot of soul-searching on why I was so set on an academic career in the first place.

Supposedly the big advantages of academia are the intellectual satisfaction of research and the freedom to research what you want. However, I didn't feel intellectually satisfied. Science works slowly, with incremental advances. Every paper I wrote was just one interpretation of one small data set about what one small brain area did in one contrived task. I was familiar with the big theories in my field, and there wasn't any new big ideas that were exciting me any more. Intellectually, focusing on such a narrow space of science was just becoming boring.

The intellectual freedom didn't sound that exciting to me anymore. Sure, I could set up a wide range of different experiments, except 1) they had to be in line with a fundable research plan, and 2) they had to lead to publications. It seemed more like pressure to come up with good ideas than freedom to do what I want.

I'm a bit ashamed to admit that for me, the factor that made the decision difficult was the level of fame and prestige that comes with being an academic researcher. It's nice to have your name on a bunch of publications, to get some media attention, and have international colleagues that respect you.

Costs of staying

My growing unhappiness forced me to really face the sacrifices I was making by staying in academia. The biggest issue for me was the cost to my personal relationships. Academia meant moving at the whims of the academic job market - due to how few jobs there are, there's little freedom in where you live geographically. Already the moves I had done for academia had cost me important relationships. There was also putting off thinking about starting a family because I didn't feel like my life was stable enough to start one.

Deciding to leave

I think there's a big disconnect in mentality between academia and industry because they offer very different types of rewards. In academia, all of the metrics you have for how well you're doing don't exist in industry: publications, citations, H-index, etc. Until I really started to feel the cost of academia in terms of my happiness, I never felt the allure of industry because it didn't offer me these rewards I had been trained to seek through my academic training. Similarly, it was easy to ignore the income one could make in industry because money isn't one of the big motivators in academia since (at least at the postdoc level) everyone is making about the same low amount.

Once I was forced to really open my eyes to the possibility of leaving, suddenly I had to consider what an industry job could offer me. It was painful going through the process of changing my mentality and accepting that I might never get another publication, but that was okay because publications only mean anything in academia.

Eventually I started learning more about data science. I learned how it would allow me to work with different data, do the parts of science I love (analysis), and give me freedom to find jobs I wanted. I thought it sounded like a much better place for me. Hopefully that judgment was right!

Update

I wrote a retrospective on my first few months in industry and how I feel now about the move from academia. See it here.