> Data science analytics is super rewarding > Leaves his data analyst job at Facebook to become a software engineer because he's tired of doing bitch work
This guy looks like Yagami Light from Death Note. He needs a shinigami.
As a poet who wants a data scientist/engineer job to just make money temporarily, "not intellectually challenging" is exactly what I'm looking for.
I've tried Data Analyst in the past and it wasn't my thing. You have to have that "analytical thinking" to translate data to words. Soon after, I switched to become a Data Engineer and have been loving it so far because as the title says for itself, it's more of an engineering role rather than analytical. There comes a task where you need to get some data in a specific format and that's it! You don't need to waste time shift through data to understand anything and that's what I love about being a Data Engineer. Data Scientists however, is a role that I have not tried yet as it requires a certain knowledge of mathematics and analytics which to be honest I have no intention to be mastered at but imho DS is an upgraded version of DA with more complexity of machine learning models and mathematics. Therefore I would say it depends on people's mindset to see which one is for them. If you think more analytical, then go with DA or DS but if you prefer less analytical and more engineering, then DE is your chance!
I felt this is because you are in a big company like Facebook. If you were in a startup or medium size company, data engineers have chance to do a lot of exciting things including algorithm, data pipeline, or even machine learning model. Nevertheless, thanks for sharing the relations between these three roles in big companies! Hope to see more video like this!
I am a data analyst/report developer, we do not have any data scientists at my place of work. ... truth be told, the data engineers at my place of work get paid more than me and my peers and they have alot less face time with the business units and costumer... but because they are so behind the scenes, the analysts are seen in a more positive light by the customers, business units and leadership than the data engineers so we get more accolades and bonuses by leadership.
Wow this is the exact opposite of my experience. In NYC the market is saturated with math / physics grads willing to work as data scientists, but who are less familiar with coding. As such wages are suppressed and it pays around $90k - $110k here. On the other hand, data engineering sits between devops and software engineering, and pays between $140k and $180k, although I have acquaintances making north of $400k as data engineers. As a data scientist you mostly write SQL queries and make Tableau dashboards on top of the ETL pipeline that data engineers built out. It's less challenging and honestly kind of mundane. Given a question, you usually know which SQL query to write to answer it. The few data scientists where I work are trying to shift into data engineering by learning more about kubernetes / spark / airflow / clojure.
Great advice on not restricting yourself! I landed a Data Engineer internship for the summer - will definitely keep this in mind and try to be as proactive as I can. Thank you Joma :)
Can we get an update on how the SWE job is going and how your life is now as a SWE compared to a DS?
I'm a data engineer , I use a variety of tools to do my job including Informatica, SQL Server, Oracle etc. As part of my role I am also learning about data governance and will soon go on training courses how to use Governance and Data Quality tools. A good data engineer would also have good working knowledge of the corporate data. I have to disagree with the notion that DE is not intellectually stimulating... but it might be different over at Facebook where you used to work.
like your video as always! I will give my two cents as a data engineer. Pay really depends on region and company. In Toronto, data engineers typically get paid higher than data scientists and software engineers. But data engineers in Toronto typically work on hadoop/spark/distributed system problem, which is different from large tech companies, like facebook.
“Technical part is the easiest part of the job at a large company” I used to work at a relatively large company in Tokyo, still it felt exactly the same!!! Thank you for uploading new video!!
Love the ending. Thank you for the advice. 👍
Can you do software engineer vs data scientist? About their pay, working hours, and which is better. Since you have experience in bothof these fields, you must be knowing a lot.
As a data engineer, it was the toughest part is constructing data quality because there are so much stress to fix things under a short period of time. The requirements constantly change so you are supposed to be flexible.
wearing patagonia... seems like someone watched the latest techlead video :D
"Take the opportunity so that you can invest in yourself so that you can be a best AT EVERYTHING!" 인생의 교훈.
Machine Learning Engineer vs Software Engineer?
DE is akin to being a construction worker. And honestly, I love it. Versus being a home architect=DS, interior designer=front end dev etc. It's a technical way to be a builder. Yes, less creative freedom and intellectually less challenging. But if you like semi mundane & repetitive tasks that still make a difference than DE is the way to go! It's more of a personality fit, I'd say.
@sanjogh777