The State Of Data Engineers


Data engineer is a newly popular job title that marries the skills of a software engineer with those of someone who works closely with data. This combination of skills within IT and technology organizations is what is driving a new breed of company to success.

Data engineers are behind turning a company's data into a leading-edge product at companies such as Uber, Airbnb, and Spotify. InformationWeek has spoken with many organizations looking to transform themselves into companies that create value out of their own data as these digital-native leaders have done.

A recent report from data startup Stitch has taken a census view from data on LinkedIn to paint a fuller picture of data engineers today.

Read the rest of Jessica Davis's article and view the Stitch data graphs on InformationWeek.

Jessica Davis, Senior Editor, Enterprise Apps, Informationweek

Jessica Davis has spent a career covering the intersection of business and technology at titles including IDG's Infoworld, Ziff Davis Enterprise's eWeek and Channel Insider, and Penton Technology's MSPmentor. She's passionate about the practical use of business intelligence, predictive analytics, and big data for smarter business and a better world. In her spare time she enjoys playing Minecraft and other video games with her sons. She's also a student and performer of improvisational comedy. Follow her on Twitter: @jessicadavis.

Success Secrets of Top Omnichannel Retailers

It's a tough and changing environment for retailers. Yet some are enjoying continued success during turbulent times. We take a closer look at how they do it.

A2 Radio: Lean Analytics for 2018

Lean Analytics author Alistair Croll joins AllAnalytics radio to talk about how to apply the process for 2018.


Re: Data moves business
  • 10/6/2016 12:50:35 AM
NO RATINGS

I think the industry will regulate job titles as it matures. I wonder when, though? AllAnalytics has been around for years now and has seen job roles evolve. I'd have thought there'd be some stability by now.

Re: Data moves business
  • 9/22/2016 5:28:38 PM
NO RATINGS

Lyndon I agree that data engineers are the more tangible and practical role but at the same time I don't see the demand for Data Scientisits going away soon. It is almost the role of the architect vs. the carpenter.

Re: Data moves business
  • 9/21/2016 2:45:31 PM
NO RATINGS

..

Maryam asks


It would be interesting to compare the requirements of data engineers are they truly a new job or old positions renamed? Also are the requirements consistent or are they buzz word job announcements?


 

I think that article I previously posted (below, "Rise of the Big Data Engineer") addresses these issues to some extent. Basically it seems to indicate that "highly skilled data scientists remain at the top of the big data food chain ...." Data engineers seem to be in demand because they're considered a bit lower-tier and possibly less expensive and perhaps more versatile for routine practical tasks. Data scientists are considered more theoretically involved, data engineers more practically oriented. 

The increased demand for more data engineers implies to me that they're both cheaper and more suited to the day-to-day run-of-the-mill data analysis tasks.

So, hit the road, theorists!

 

Re: Data moves business
  • 9/21/2016 12:30:14 PM
NO RATINGS

It would be interesting to compare the requirements of data engineers are they truly a new job or old positions renamed? Also are the requirements consistent or are they buzz word job announcements?

Re: Data moves business
  • 9/21/2016 9:36:43 AM
NO RATINGS

It does seem the "engineer" term is becoming more and more loosely defined. I'm not sure if this may be a result of pinning job title in lieu of salary increases, or even the varying definitions and useage of engineer in other countries that sometime have an even broader definition.

Re: Data moves business
  • 9/20/2016 7:42:58 PM
NO RATINGS

..

Maryam asks


... there is definitely high demand but are the job descriptions realistic or are they looking for someone that doesn't exist?


 

I'd think that "Data Engineer" implies someone with an actual Engineering degree. However, I've seen situations where somebody's position is called an "engineer" but is really just a kind of technician.

And then there's the guy (or gal) who runs a railroad locomotive ... He or she is called an "engineer" (since the 19th century, actually) but really is just a vehicle driver with special extra skills.

..

Re: Data moves business
  • 9/20/2016 5:46:24 PM
NO RATINGS

@maryam, very true! I've often heard someone attempt to describe a job title by saying 'kind of like' versus the detailed function. Usually a red flag.

Re: Data moves business
  • 9/20/2016 5:12:47 PM
NO RATINGS

Lyndon incredible stats there is definitely high demand but are the job descriptions realistic or are they looking for someone that doesn't exist?

Re: Data moves business
  • 9/20/2016 5:02:25 PM
NO RATINGS

..

Jessica Davis writes


Data engineer is a newly popular job title that marries the skills of a software engineer with those of someone who works closely with data. 


 

I was looking for stats on the increase in Data Engineer jobs. Didn't really find any, but I did find another interesting article: Rise of the Big Data Engineer.

This includes the following excerpt:


Figures from job posting websites show much higher demand for data engineers than for data scientists:

• LinkedIn currently has nearly 21,000 postings for jobs with "data engineer" in the title, compared to just over 11,000 for jobs with "data scientist" in the title.
• Indeed.com shows more than 90,000 hits for data engineer jobs, compared to about 11,000 for data scientist.
• Dice.com has more than 13,000 postings for data engineer, while only about 500 for data scientists.
• CareerBuilder.com has fewer than 1,000 postings for data scientist positions in the past 30 days, compared to more than 16,000 for data engineers.


 

It's hard to imagine data scientists crowding onto the unemployment lines, but times do change ...

 

Re: Data moves business
  • 9/20/2016 4:39:28 PM
NO RATINGS

I agree about the usefulness of dat engineers. It would be nice to have degress in the field and a standard definition of this discipline.

Page 1 / 2   >   >>
INFORMATION RESOURCES
ANALYTICS IN ACTION
CARTERTOONS
VIEW ALL +
QUICK POLL
VIEW ALL +