Big Data in 2015—Power to the People!

December 16, 2014

Last year I speculated that the big data ‘power curve’ in 2014 would be shaped by business demands for data blending. Customers presenting at our debut PentahoWorld conference last October, from Paytronix, to RichRelevance, to NASDAQ, certainly proved my speculations to be true. Businesses like these are examples of how increasingly large and varied data sets can be used to deliver high and sustainable ROI. In fact, Ventana Research recently confirmed that 22 percent of organizations now use upwards of 20 data sources, and 19 percent use between 11 – 20 data sources.[1]

Moving into 2015, and fired up by their initial big data bounties, businesses will seek even more power to explore data freely, structure their own data blends, and gain profitable insights faster. They know “there’s gold in them hills” and they want to mine for even more!

With that said, here are my big data predictions for 2015:

Big Data Meets the Big Blender!

The digital universe is exploding at a rate that even Carl Sagan might struggle to articulate. Analysts believe it’s doubling every year, but with the unstructured component doubling every three months. By 2025, IDC estimates that 40 percent of the digital universe will be generated by machine data and devices, while unstructured data is getting all the headlines.[2] The ROI business use cases we’ve seen require the blending of unstructured data with more traditional, relational, data. For example, one of the most common use cases we are helping companies create is a 360 view of their customers. The de facto reference architecture involves the blending of relational/transactional data detailing what the customer has bought, with unstructured weblog and clickstream data highlighting customer behavior patterns around what they might buy in the future. This blended data set is further mashed up with social media data describing sentiment around the company’s products and customer demographics. This “Big Blend” is fed into recommendation platforms to drive higher conversion rates, increase sales, and improve customer engagement. This “blended data” approach is fundamental to other popular big data use cases like Internet of Things, security and intelligence applications, supply chain management and regulatory and compliance demands in Financial Services, Healthcare and Telco industries.

Internet of Things Will Fuel the New ‘Industrial Internet’

Early big data adoption drove the birth of new business models at companies like our customers Beachmint and Paytronix. In 2015, I’m convinced that we’ll see big data starting to transform traditional industrial businesses by delivering operational, strategic and competitive advantage. Germany is running an ambitious Industry 4.0 project to create “Smart Factories” that are flexible, resource efficient, ergonomic and integrated with customers and business partners. The machine data generated from sensors and devices, are fueling key opportunities like Smart Homes, Smart Cities, and Smart Medicine, which all require big data analytics. Much like the ‘Industrial Internet’ movement in the U.S., Industry 4.0 is is being defined by the Internet of Things. According to Wikibon, the value of efficiency from machine data could reach close to $1.3 trillion dollars and will drive $514B in IT spend by 2020.[3]The bottlenecks are challenges related to data security and governance, data silos, and systems integration.

Big Data Gets Cloudy!

As companies with huge data volumes seek to operate in more elastic environments, we’re starting to see some running all, or part of, their big data infrastructures in the cloud. This says to me that the cloud is now “IT approved” as a safe, secure, and flexible data host. At PentahoWorld, I told a story about a “big datathrow down” that occurred during our Strategic Advisory Board meeting. At one point in the meeting, two enterprise customers in highly regulated industries started one-upping each other about how much data they stored in Amazon Redshift Cloud. One shared that they processed and analysed 5-7 billion records daily.. The next shared that they stored a half petabyte of new data every day and on top of that, they had to hold the data for seven years while still making it available for quick analysis. Both of these customers are held to the highest standards for data governance and compliance – regardless of who won, the forecast for their big data environments is the cloud!

Embedded Analytics is the New BI

Although “classic BI,” which involves a business analyst looking at data with a separate tool outside the flow of the business application, will be around for a while, a new wave is rising in which business users increasingly consume analytics embedded within applications to drive faster, smarter decisions. Gartner’s latest research estimates that more than half the enterprises that use BI now use embedded analytics.[4] Whether it’s a RichRelevance data scientist building a predictive algorithm for a recommendation engine, or a marketing director accessing Marketo to consume analytics related to lead scoring or campaign effectiveness, the way our customers are deploying Pentaho leave me with no doubt that this prediction will bear out.

As classic BI matured, we witnessed a final “tsunami” in which data visualization and self-service inspired business people to imagine the potential for advanced analytics. Users could finally see all their data – warts and all – and also start to experiment with rudimentary blending techniques. Self-service and data visualization prepared the market for what I firmly expect to be the most significant analytics trend in 2015….

Data Refineries Give Real Power to the People!

The big data stakes are higher than ever before. No longer just about quantifying ‘virtual’ assets like sentiment and preference, analytics are starting to inform how we manage physical assets like inventory, machines and energy. This means companies must turn their focus to the traditional ETL processes that result in safe, clean and trustworthy data. However, for the types of ROI use cases we’re talking about today, this traditional IT process needs to be made fast, easy, highly scalable, cloud-friendly and accessible to business. And this has been a stumbling block – until now. Enter Pentaho’s Streamlined Data Refinery, a market-disrupting innovation that effectively brings the power of governed data delivery to “the people,” unlocking big data’s full operational potential. I’m tremendously excited about 2015 and the journey we’re on with both customers and partners. You’re going to hear a lot more about the Streamlined Data Refinery in 2015 – and that’s a prediction I can guarantee will come true!

Finally, as I promised at PentahoWorld in October, we’re only going to succeed when you tell us you’ve delivered an ROI for your business. Let’s go forth and prosper together in 2015!

Quentin Gallivan, CEO, Pentaho

120914-Quentin-Big-Data-2015-Prediction-Graphic

[1] Ventana Research, Big Data Integration Report, Tony Cosentino and Mark Smith, May 2014.

[2] IDC, The Digital Universe of Opportunities: Rich Data and the Increasing Value of the Internet of Things, Gantz, Minton, Turner, Reinsel, Turner, April 2014.

[3] Wikibon, Defining and Sizing the Industrial Internet, David Floyer, June 2013.

[4] Gartner, Use Embedded Analytics to Extend the Reach and Benefits of Business Analytics, Daniel Yuen, October 3, 2014.


Ventana Research on PentahoWorld, company success and 5.2

December 15, 2014

It has been a busy year for Pentaho. A few highlights include: PentahoWorld, our inaugural worldwide users conference, two new product releases (5.1 & 5.2) and a refreshed 36-month vision for our product roadmap and the future of analytics.

In the opening PentahoWorld keynote Pentaho Chairman and CEO, Quentin Gallivan, shared the top three trends driving Pentaho’s vision for governed data to be delivered “at the point of business impact.” These include:

  1. The universe of data is exploding and data is connecting people and things
  2. Evolving data architectures are required to blend data sets
  3. Users expect to consume data in new ways

These trends all align with our latest release Pentaho 5.2 and our vision for a “data orchestration platform.” We were fortunate to have Tony Cosentino, VP and Research Director at Ventana Research attend PentahoWorld to hear about our announcements and keynote firsthand as well as meet with several customers. The team at Ventana Research and Tony have spent time with us over the years discussing, guiding and watching our future unfold. We encourage you to read his first-hand point of view of PentahoWorld, the reasons behind our success and highlights of our latest 5.2 release. Tony summed it up best calling out our focus on “targeted yet flexible” solutions. We know you will be enlightened and impressed.

Read: Pentaho Presents Big Data Orchestration Platform with Governance and Data Refinery

cropped-vr_cosentino_blog_header

Donna Prlich
VP of Product Marketing
Pentaho


Big Data Powers Big Deals this Holiday Season

November 25, 2014

BlackFridayCyberMonday

It’s almost that time of year – where retailers offer ridiculous discounts enticing holiday shoppers to buy gifts for their loved ones and themselves. While many will wait with bellies full of Thanksgiving turkey for blow out sales at 12:01AM on Black Friday, more than half of the U.S. consumers will instead search for deals online, scouring the Internet for Cyber Monday deals.

The November 2014 Forrester Research, Inc. Report, US Online Holiday Forecast, 2014 (Access Requires Subscription), states that online sales will reach $89 billion this holiday season. Companies are doing all they can to prepare for the surge in demand and strain to come for both IT departments and inventory. With the recent IPO of Alibaba, retailers, now more than ever, are feeling pressure on their margins and realizing that they’ll need to gain insight about their customers if they hope to be competitive against the Amazons and Alibabas of the world. Companies leveraging scalable and flexible Big Data analytics solutions to gain those insights will be ahead of their peers this holiday season (and beyond).

Pentaho is helping customers such as RichRelevance®, the global leader in omnichannel personalization, and The Lucky Group, a venture backed social commerce company, to prepare for the immense volumes of data associated with Cyber Monday, while providing insight into customers’ behaviors, preferences and needs. By leveraging Pentaho, they are able to use data to deliver something core to their customers that others can’t – personalization.

With a four times surge in both data volumes and internet traffic expected from desktop browsers and mobile shoppers this year, Big Data will be critical for the success, if not survival, of companies big and small.

How is your company leveraging big data to flourish over the holidays?

Read the press release about how Pentaho helps retailers power big deals for consumers this holiday season.

Follow @Pentaho on Twitter & Facebook to receive discount codes from our awesome retail customers to take advantage of Black Friday and Cyber Monday deals.


PentahoWorld Celebrates Regional Partner of the Year Award Winners

October 30, 2014

This year we celebrated our Regional Partner of the Year Award winners at a ceremony held during our first annual worldwide conference, PentahoWorld, in Orlando, Florida.

Co-Founder and Chief Strategy Officer Richard Daley handed out awards to BizCubed (APAC), BNova (EMEA) and Oncase (LATAM) in front of 400 attendees representing 27 countries.

Our Partner Awards recognize the top achieving partner in the three reseller regions APAC, EMEA and LATAM based on business services, growth and engagement in the local market.

Partners’ contributions from around the globe have been an instrumental part of Pentaho’s 10-year success story. Much more than resellers, our partners are all Pentaho experts, providing the valuable technical and consulting services that ensure each customer project is successful.

Congratulations to each winner for their incredible achievement!

Winners of the Pentaho Regional Partner of the Year Award

 APAC Partner of the Year: BizCubed

bizcubed group

BizCubed is a long-standing Pentaho partner in Australia and New Zealand. Their Pentaho business has grown very rapidly in the past year, delivering highly successful projects to companies like DeBertoli Wines and Westfield shopping malls. The team has also executed a broad range of marketing activities, which sees them continuing to grow the market “down under”.

EMEA Partner of the Year: BNova

BNova

Italy’s BNova has had a banner year, bringing on board several new Pentaho customers and substantially growing its big data business. Big data has now gone from being an emerging trend into an integral part of BNova’s business. Its recent BigDataTech event in Florence was highly successful, with more than 200 delegates keen to learn more about big data solutions.

LATAM Partner of the Year: Oncase

oncase group

Oncase from Brazil has shown the remarkable ability to expand customer accounts by starting small and proving their worth. This, coupled with the great customer service they provide, has enabled them to significantly build their business in this burgeoning market.

Read the rest of this entry »


Achieving Equilibrium Between Business and IT

October 16, 2014

Last week, Pentaho unveiled a Big Data Orchestration Platform instrumental to a data-driven future– one where analytics and data are embedded into the fabric of the organization to drive real time business decisions. Fundamental to Pentaho’s strategy is the concept of governed data delivery – the ability to blend trusted and timely data to power analytics at scale for all users and in all environments.

Today, at Strata + Hadoop World, Pentaho announced new automated data modeling and publishing capabilities to help organizations establish a Streamlined Data Refinery solution architecture – empowering business users while still meeting IT requirements.

Pentaho is putting governed, blended data from across the enterprise at business users’ fingertips. You can watch the video demo here:

Achieving the end result of empowering business users with the ability to blend and refine data for business and regulatory purposes, while supporting IT with governed orchestration processes and data delivery methods.is the basis of a Streamlined Data Refinery Here are two of our customers achieving the business and IT balance.

Tim Garnto, SVP of Product Engineering at edo Interactive explains, “Having lightning fast data analytics is a matter of survival for our team. In early 2013, we hit a wall due in part to the sheer amount of data we could access. We just couldn’t process the data fast enough with our existing SQL database, as a result, we couldn’t get the right offers to the right people quickly enough. Leveraging the Streamlined Data Refinery architecture with Pentaho we were able to extract, integrate and analyze 25 million transactions a day consisting of over 50TB of data. As a result, we cut the processing window from 29 hours to under four all while growing the amount of data processed by 974 percent.”

Robert Clark, VP of Development, 4SightBI shares, “In order for our customer base of agents, brokers, actuaries and managers to deliver quality reports that result in faster sales closings, they require quick turnaround and mobile visibility into the data, without having to wait on IT. With the automation of a Streamlined Data Refinery, our customers planning to use Hadoop will soon be able to see a further reduction in the time it takes for us to produce actionable insights by minimizing time spent on preparing data, all while still delivering relevant data sets with governance.”

Donna Prlich
VP, Product Marketing
Pentaho


Pentaho 5.2, Marching Towards Governed Data Delivery

October 9, 2014

Q on stageIn our hyper-competitive global economy, companies are urgently seeking to harness the value from all their data to find new revenue streams, operate more efficiently, deliver outstanding service and minimize risk. They need a platform that catalyzes collaboration between IT and business to meet demands both for governance and the business need for timely, comprehensive data.

Today at PentahoWorld we’ve committed to leading the charge towards a truly data-driven future, starting with governed data delivery.

In his keynote, Pentaho Chairman and CEO, Quentin Gallivan lifted the veil on a big data orchestration platform that will be instrumental in delivering this vision by overcoming three persistent big data challenges: need for strong data governance, diverse data blending, and delivery of analytics embedded at the point of impact. Fundamental to Pentaho’s strategy is the concept of governed data delivery, defined as the ability to blend trusted and timely data to power analytics at scale for all users in all environments.

Also announced today, Pentaho 5.2 includes new innovations to simplify delivery of blended data sets with IT trust, planting new guideposts on the road to governed data delivery.

chris

Automated Streamlined Data Refinery

IT can hand the power of data driven analytics to the business with an automated Streamlined Data Refinery. Hadoop serves as a central processing hub where analytics ready data sets can be blended, refined, auto-modeled, and automatically published directly to analytic data bases like HP Vertica for high performance interactive analytics using Pentaho Analyzer.

Advanced Data Security in Hadoop

Pentaho 5.2 extends the adaptive big data layer with advanced capabilities for Kerberos security support for major Hadoop distributions, including Cloudera, Hortonworks and MapR. This ensures that only those users with proper credentials can access Hadoop cluster resources in their data orchestration.

Pentaho 5.2 also includes additional features that simplify the user experience for both embedded and direct customers.

Learn more about Pentaho 5.2 and Governed Data Delivery – watch the video and read the whitepaper at www.pentaho.com/product/governed-data-delivery.

Follow PentahoWorld live on Twitter using the hashtag #PWorld2014.

Chuck Yarbrough
Product Marketing, Big Data
Pentaho


Marist College Positively Impacts Higher Education with Pentaho

September 24, 2014

MaristLargeLogoRedMarist College is a medium-sized school with a Big Data promise – to help all students graduate. The liberal arts college in Poughkeepsie, New York, is taking a data-driven approach to education by utilizing big data and predictive analytics to tackle the degree completion crisis that’s trending in higher education across America. As of January 2014, the percentage of full-time students at four-year institutions who complete a bachelor’s degree in four years is only 37.9%, and the completion rate after six years is only 58.3%. By deploying Pentaho Business Analytics, Marist College has developed a completely open-source “academic early alert” system for identifying students at the start of a course who are at risk to not complete it and then deploying interventions to help those students succeed.

Based on a predictive model, the goal of the Open Academic Analytics Initiative (OAAI) was to create an open model for academic success that all institutions can use, customize and build upon through open-source community collaboration.

Marist hopes this initiative will help advance our general understanding of technology-mediated intervention strategies, and through the leadership of Bill Thirsk, Vice President of IT/CIO at Marist College, the program is already proving beneficial – Marist College’s OAAI can determine at the 75-79% accuracy range how well a student is going to perform in a course within two weeks!

Learn more about how with Pentaho’s solution at Marist College is positively impacting the world of higher education.


Follow

Get every new post delivered to your Inbox.

Join 105 other followers