Julie Lockner

High-Performance, Big Data Analytics Takes a Certain Understanding

View Comments: Newest First | Oldest First | Threaded View
Page 1 / 2   >   >>
Daniel
User Rank
Data Doctor
Tight integration of tools and resources
Daniel   2/22/2012 2:17:14 AM
NO RATINGS
1 saves
I think for analysis along with platform, tools also matters. Whatever may be the platform, the ability of tools to interactive and make use of the underlined resources are important. If the tools are not compactable with the deployed hardware and associated software, then the analysis process may happen with lesser speed, there may be always certain bottlenecks.

Lyndon_Henry
User Rank
Blogger
Re: Link between HPA and automation?
Lyndon_Henry   2/21/2012 10:10:25 PM
NO RATINGS
Julie writes
if you need to be able to execute a ranking algorithm in near real-time to identify a fraudulent activity, the model needs to be able to complete in microseconds to milliseconds. Delivering results in such speedy fashion means giving the business the ability to react quickly and with the agility that's much desired.


One would think credit card companies would be big users. I wonder approximately what the percentage is of credit card companies that are delopying this technology (HPC analytics etc.). I'd also wonder if this enables some more technologically forward-thinking companies to react to fraud faster than others.

Shawn Hessinger
User Rank
Blogger
Re: Link between HPA and automation?
Shawn Hessinger   2/21/2012 8:42:25 PM
NO RATINGS
Hi Seth,

Good strategy, in fact, but I'm imagining this is already something companies generally do when deploying big data analytics.

Hospice_Houngbo
User Rank
Prospector
Re: Link between HPA and automation?
Hospice_Houngbo   2/21/2012 6:51:42 PM
NO RATINGS
@SethBreedlove:

" high performance is relalitve"..."What makes one company agile isn't the same for everyone. "


High performance evaluation may indeed depend on the company's data processing needs and requirements. Companies should first try to audit and understand such needs in oder to choose the right analytics tools.

SethBreedlove
User Rank
Data Doctor
Re: Link between HPA and automation?
SethBreedlove   2/21/2012 4:45:11 PM
NO RATINGS
I guess it would only make sense high performance is relalitve.  that different companies would have different values on saving costs, performance and speed. 

As mentioned in the article, banks need answers in milliseconds when it comes to fraud prevention, while Procter and Gamble would have very different needs. 

What makes one company agile isn't the same for everyone. 

Shawn Hessinger
User Rank
Blogger
Re: Link between HPA and automation?
Shawn Hessinger   2/21/2012 2:49:13 PM
NO RATINGS
Great example, Julie, and, no doubt, another payoff for the overall investment!

Julie Lockner
User Rank
Blogger
Re: High End Server versus HPC's
Julie Lockner   2/21/2012 2:39:18 PM
NO RATINGS
Hi Louis, This environment had both an HPC and data warehouse environment. The team wanted to be able to enhance the DW with more detailed data and have the HPC environment have access to it.  This new architecture added Hadoop as the landing place for detailed data that was accessible to both environments.  Once they found how much quicker it was to add data elements tot he model, that was just the beginning of new opportunities.

Louis Watson
User Rank
Blogger
High End Server versus HPC's
Louis Watson   2/21/2012 12:45:01 PM
NO RATINGS

Hi Julie,  Was this difference in job processing time in an Oracle World versus Hadoop due to HPC's  alone ?  Or were there any other changes ?

Are these high-end systems on the backend or HPC's ? 


BethSchultz
User Rank
Blogger
Re: Link between HPA and automation?
BethSchultz   2/21/2012 12:14:14 PM
NO RATINGS
@JulieLockner,  fewer false positives and quicker response time certainly would be ideal in fraud detection analytics! I'm curious, outside of latency-sensitive operational analytics are there some areas where companies just aren't willing to get quite as automated with their responses as they might?

Julie Lockner
User Rank
Blogger
Re: Link between HPA and automation?
Julie Lockner   2/21/2012 11:42:45 AM
NO RATINGS
Hi Shawn, From an agility perspective, one Hadoop user had a challenge with their ability to add attributes to their Cognos cube for a risk model.  The job took 4 days to complete with Oracle.  When they switched the underlying data store to Hadoop, they were able to reduce that rebuild to 1 day.  From a new opportunity perspective, another user was not able to support their business users' request to mine detailed transactional data to identify opportunities to improve business process efficiencies because the warehouse could not scale.  The warehouse was only designed to look at aggregate data.  By opening up detailed transactional data cost affordably on a Hadoop cluster, they could investigate as to why processes were inefficient.

Page 1 / 2   >   >>
Information Resources
More Blogs from Julie Lockner
Big data requires nontraditional IT approaches -- remember that in your analytics considerations.
Radio Show
Radio Shows
ARCHIVE
James M. Connolly
Analytics: Your Defense Against Cyber Threats


5/27/2015  LISTEN   60
ARCHIVE
James M. Connolly
Big Data & Big Pharma: How Analytics Might Save Your Life


5/19/2015  LISTEN   37
ARCHIVE
James M. Connolly
Live Interviews From SAS Global Forum


4/28/2015  LISTEN   11
ARCHIVE
James M. Connolly
How to Hire Great Analytics Talent


4/23/2015  LISTEN   51
ARCHIVE
James M. Connolly
Sports Analytics Mean Fun and Business


3/24/2015  LISTEN   4
ARCHIVE
James M. Connolly
Secure Your Big Data in the Cloud


2/26/2015  LISTEN   114
ARCHIVE
James M. Connolly
Make It Big As a Data Scientist in 2015


2/11/2015  LISTEN   106
ARCHIVE
James M. Connolly
Big Data, Decisions & the Simulated Experience


2/3/2015  LISTEN   87
ARCHIVE
James M. Connolly
A Chat About Big Data, Machine Learning & Value


1/15/2015  LISTEN   125
ARCHIVE
Curtis Franklin Jr.
An Infrastructure for Analytics


12/18/2014  LISTEN   63
Information Resources
Quick Poll
Quick Poll
Infographic
Infographic
It Pays to Keep Insurance Fraud in Check
While 97% of insurers say that insurance fraud has increased or remained the same in the past two years, most of those companies report benefits from anti-fraud technology in limiting the impact of fraud, including higher quality referrals, the ability to uncover organized fraud, and improve efficiency for investigators.
Follow us on Twitter
Follow us on Twitter
Cartoon
CARTERTOONS
Like us on Facebook
Like us on Facebook
About Us  |  Contact Us  |  Help  |  Register  |  Twitter  |  Facebook  |  RSS