RSS

Tag Archives: Gartner

Magic Quadrant Business Intelligence 2014

Over the last two years we have posted some visualization and interpretation of Gartner’s Magic Quadrant Analysis on BI companies. The previous articles in 2012 and 2013.

A Blog reader contacted me about the 2014 update; he sent me the {x,y} coordinate data for 2014 and so it was relatively straightforward to update the public Tableau workbook for it. Here is the image of all 29 companies with their changes from 2013 to 2014:

Gartner’s Magic Quadrant for Business intelligence, changes from 2013 to 2014

Gartner’s Magic Quadrant for Business intelligence, changes from 2013 to 2014

With the slider controls for Execution and Vision as well as the changes thereof, it is easy to filter the dashboard interactively. For example, there were a dozen companies who improved in their execution score (moving up in the quadrant):

Subset of companies who improved execution over the last year.

Subset of companies who improved execution over the last year.

Most of the companies improving their execution are niche players, with SAP being the only leader improving its execution score.

Most of the leaders improved in their vision score (moving right in the quadrant), including Tableau, QlikTech, Tibco and SAS.

Subset of companies who improved vision over the last year.

Subset of companies who improved vision over the last year.

 

7 companies, most of them leaders, lost ground on both execution and vision (moving to the bottom-left):

Companies who lost ground on both execution and vision in 2014

Companies who lost ground on both execution and vision in 2014

 

Lastly, I have updated the Public Tableau workbook with the Magic Quadrant as originally published in 2012 with the data for 2013 and 2014. (Click here for the interactive drawing.)

Public Tableau workbook with 7 years of BI Magic Quadrant data.

Public Tableau workbook with 7 years of BI Magic Quadrant data.

 
1 Comment

Posted by on September 28, 2014 in Industrial

 

Tags: , , , ,

Magic Quadrant Business Intelligence 2013

It’s that time of the year again: Gartner has released its report on Business Intelligence and Analytics platforms. One year ago we looked at how the data in the Magic Quadrant – the two-dimensional space of execution vs. vision – can be used to visualize movement over time. In fact, the article Gartner’s Magic Quadrant for Business Intelligence became the most viewed post on this Blog.

I had also uploaded a Tableau visualization to Tableau Public, where everyone can interact with the trajectory visualization and download the workbook and the underlying data to do further analysis. This year I wanted to not only add the 2013 data, but also provide a more powerful way of analyzing the dynamic changes, such as filtering the data. For example, consider the moves from 2012 to 2013 of some 21 vendors:

Gartner's Magic Quadrant for Business intelligence, changes from 2012 to 2013

Gartner’s Magic Quadrant for Business intelligence, changes from 2012 to 2013

It might be helpful to filter the vendors in this diagram, for example to show just niche players, or just those who improved in both vision and execution scores. To that end, I created a simple Tableau dashboard with four filters: A range of values for the scores of both vision and execution scores, as well as a range of values for the changes in both scores. The underlying data is also displayed for reference, which can then be used to sort companies by ordering along those values.

Here is an example of the dashboard set to display the subset of 15 companies who increased either both or at least one of their vision or execution scores without lowering the other one.

Subset of companies who improved vision and/or execution over the last year.

Subset of companies who improved vision and/or execution over the last year.

That’s more than 70% of platforms, with the increase in vision being more pronounced than that of execution. That’s considerably more than in the previous years (2013: 15; 2012: 6; 2011: 6; 2010: 3; 2009: 9) – making this collective move to the top-right perhaps a theme of this year’s report.

Who changed Quadrants? Who moved in which dimension?

Last year Tibco (Spotfire) and Tableau were the only two platforms changing quadrants, then becoming challengers. This year both of them “turned right” in their trajectory and crossed over into the leaders quadrant due to strong increases in their vision capabilities. (QlikTech had been on a similar trajectory, but already crossed into the leader quadrant in 2012. It also strengthened both execution and vision again this year.)

Another new challenger is LogiXML. Thanks to ease of use, enhancements from customer feedback and a focus on the OEM market its ability to execute increased substantially. From the Gartner report summary on LogiXML:

Ease of use goes hand-in-hand with cost as a key strength for LogiXML, which is reflected by its customers rating it above average in the survey. The company includes interfaces for business users and IT developers to create reports and dashboards. However, its IT-oriented, rapid development environment seems to be most compelling for its customers. The environment features extensive prebuilt elements for creating content with minimal coding, while its components and engine are highly embeddable, making LogiXML a strong choice for OEMs.

A few other niche players almost broke into new quadrants, including Alteryx (which had the biggest overall increase and almost broke into the visionary quadrant), as well as Actuate and Panorama Software.

The latter two stayed the same with regards to execution (as did SAP) – while all three of them moved strongly to the right to improve on the vision score (forming the Top 3 of vision improvement).

Information Builders and Oracle stayed where they were, changing neither their execution nor vision scores.

Microsoft and Pentaho stayed about the same on vision, but increased substantially in their execution scores.  This propelled Microsoft to the top of the heap on the execution score, while it moved Pentaho from near the bottom of the heap to at least a more viable niche player position. Microsoft’s integration of BI capabilities in Excel, SQL Server and SharePoint as well as leveraging of cloud services and attractive price points make it a strong contender especially in the SMB space. Improvements of its ubiquitous Excel platform give it a unique position in the BI market. From the Gartner report:

Nowhere will Microsoft’s packaging strategy likely have a greater impact on the BI market than as a result of its recent and planned enhancements to Excel. Finally, with Office 2013, Excel is no longer the former 1997, 64K row-limited, tab-limited spreadsheet. It finally begins to deliver on Microsoft’s long-awaited strategic road map and vision to make Excel not only the most widely deployed BI tool, but also the most functional business-user-oriented BI capability for reporting, dashboards and visual-based data discovery analysis. Over the next year, Microsoft plans to introduce a number of high-value and competitive enhancements to Excel, including geospatial and 3D analysis, and self-service ETL with search across internal and external data sources.

The report then goes on to praise Microsoft for further enhancements (queries across relational and Hadoop data sources) that contribute to its strong product vision score and “positive movement in overall vision position”. This does not seem consistent with the presented Magic Quadrant, where Microsoft only moved to the top (execution), not to the right (vision). Perhaps another reason for Gartner to publish the underlying coordinate data and finally adopt this line of visualization with trajectories.

Deteriorate2013

Dashboard with filters revealing two platforms deteriorating in both vision and execution

Only two vendors saw their scores deteriorate in both dimensions: MicroStrategy gave up some ranks, but remains in the leader quadrant. The report cites a steep sales decline in 3Q12 and the increased importance of predictive and prescriptive analytics in this years evaluation among the reasons:

MicroStrategy has the lowest usage of predictive analytics of all vendors in the Magic Quadrant. A reason for this behavior might be the user interface that is overfocused on report design conventions and lacks proper data mining workbench capabilities, such as analysis flow design, thus failing to appeal to power users. To address this matter, MicroStrategy should deliver a new high-end user interface for advanced users, or consumerize the analytic capabilities for mainstream usage by embedding them in Visual Insight.

The other vendor moving to the bottom-left is arcplan, which is now at the bottom of the heap in the niche players quadrant.

Who moved to the top-left?

With the dashboard at hand, you can also go back and do similar queries not just for the current year 2013, but any of the five previous years. For example, who has moved to the top-left – improved execution at the expense of reduced vision – over the years?

In 2013 those were Targit, Jaspersoft, Board International. All three of them had a sharp drop in Execution in the previous year 2012. A plausible scenario of what happened is that these companies lost their focus on execution, dropped the scores and in an attempt to turn-around focused on executing well with a smaller set of features (hence lower vision).

In 2012 the only vendor to display a move to the top-left was QlikTech. They had some sales issues the prior year as well, although their trajectory in 2011 was only modestly lower in execution, mostly towards higher vision.

In 2011 Actuate and Information Builders moved to the top-left. Both had trajectories to the bottom-left the prior year (2010), with especially Actuate losing a lot of ground. With the Year slider on the top-left of the dashboard one can then play out the trajectory while the company filters remain, thus showing only the filtered subset and their history. Actuate completed a remarkable turn-around since then and is now positioned back roughly where it was back in 2010.

Dashboard with analysis of top-left moving companies.

Dashboard with analysis of top-left moving companies.

 

(Click on the image above or here to go to the interactive Public Tableau website.)

In 2010 there were five vendor moving to the top-left: Oracle, SAS, QlikTech, Tibco (Spotfire) and Panorama Software. Although in that case none of them did show a decrease in execution the previous year. That focus on execution may simply have been the result of the economic downturn in 2009.

Such exploratory analysis is hard to conceive without proper interactive data visualization. Given the focus of all the vendors it covers in this report, it seems somewhat anachronistic that Gartner in its report does not leverage the capabilities of such interactive visualization itself. In the previous post on Global Risks we have seen how much value that can add to such thorough analysis. (Much of this dashboard should be applicable for risk analysis as well, just that the two-dimensional space changes from platform vision vs. execution to risk likelihood vs. impact!) If Gartner does not want to drop on its own execution and vision scores, they better adopt such visualization. It’s time.

 
3 Comments

Posted by on February 12, 2013 in Industrial

 

Tags: , , , ,

Gartner’s Magic Quadrant for Business Intelligence

Gartner’s Magic Quadrant for Business Intelligence

Note: See also the more recent update on the Magic Quadrant for Business Intelligence 2013.

The Gartner group publishes an annual report called Magic Quadrant of Business Intelligence. It compares various vendors in two dimensions: Ability to Execute and Completeness of Vision. These two dimensions span up four quadrants (leaders, challengers, visionaries, niche players).

The key graphic in the Gartner reports is the so called Magic Quadrant diagram. Here is the 2012 version (click the image to see the full report):

Magic Quadrant of BI 2012 (Source: Gartner)

Similar charts have been published for 2011, 2010, 2009, and 2008 (source: Google Image Search).

From these snapshots in time one can create a time-series and compare relative movement of vendors. Here is an interactive version of such a chart created with Tableau Public: (Click on chart below to interact.)

Interactive BI_MagicQuadrant 2008-2012

Disclaimer: There are at least two caveats here: One is the limited quality of the data. The other is the limited applicability of this type of visualization.

Quality: I have contacted two of the authors at Gartner and asked for the (x,y-coord) data of those Magic Quadrants. However, Gartner’s policy is to not disclose these data. Hence I screen-scraped the coordinates off the publicly available images. This brings with it limited accuracy to measure the positions from the images and the possibility of (my) clerical error in entering that data in a spreadsheet.

Applicability: The contacted authors (James Richardson and John Hagerty) both emphasized that due to subtle changes in the way the dimension score is calculated each year such sequential comparisons are not supported by Gartner. In other words, the data may show misleading or unintended conclusions.

Discussion: Of course the original Gartner reports provide a tremendous amount of detail, both around the methodology (which factors contribute to Vision and Execution scores) and on the various vendors, their products and other relevant business aspects like sales channels etc. One also needs to bear in mind that some of these companies emerge or disappear over time.

That said, the interactive time-series chart has many advantages over the individual snapshots:

  • You can select a subset of companies (for example all public companies)
  • Companies are identified by label and color
  • History can be traced for consecutive years
  • Trends are more easily detected (see also Disclaimer above)

For example, smaller but rapidly growing companies like Tibco (Spotfire) and Tableau have somewhat vertical trajectories leading them into the “challenger” quadrant with strong increases in the ability to execute. Tibco and QlikTech are the only 2 (of 24) companies to change quadrants in the last 5 years, from visionary to challenger (Tibco) and leader (QlikTech), respectively.

MQ trajectory for Tableau, Tibco, and QlikTech

Some big public companies like IBM, SAP and Microsoft have invested heavily over the last years in the BI space. This has resulted in a more horizontal trajectory within the leader quadrant as they have increased the completeness of their vision, among others through acquisitions of smaller companies (SAP bought Business Objects, IBM bought Cognos).

MQ trajectory for IBM, SAP, and Microsoft

Some individual trajectories are more dynamic than others. For example MicroStrategy has had strong increases first in vision (2008-2009) and then in their ability to execute (2010-2012). By contrast, Actuate has fallen behind relative to others in both execution and vision in the first 3 years, only to stop (2011) and revert (2012) that trend in recent years.

MQ trajectory for Actuate and MicroStrategy

Bottom Line: Data presented via Interactive Charts invites exploration, discovery, and better understanding. Through Tableau Public these charts can easily be shared with others. The Magic Quadrant data is originally curated and presented by Gartner in the traditional snapshot moment-in-time format. IMHO, in this interactive time-series format the data comes to live and yields additional insight. I’d be interested to hear your thoughts and comments on the caveats from the authors about the limited applicability of the time series animation?

 
5 Comments

Posted by on February 20, 2012 in Industrial

 

Tags: , , ,

 
%d bloggers like this: