2015 big data market update: Enterprise use cases and moving from traditional databases

(c)iStock.com/sorbetto

  • 42.6% of all big data apps developed for manufacturing are being created by enterprises today.
  • 38.2% of all big data and advanced analytics apps in use today are in customer-facing departments including marketing, sales, and customer service.
  • 33.2% of all big data and advanced analytics developers are concentrating on the software & computing industry.
  • 19.2% of big data app developers say quality of data is the biggest problem they consistently face when building new apps.

These and other insights are from the recently published report Big Data and Advanced Analytics Survey 2015, Volume I by Evans Data Corporation. The survey is based on 444 in-depth interviews with developers who are currently working with analytics and databases and are both currently working on and planning big data and advanced analytics projects. The survey’s results provide a strategic view of the attitudes, adoption patterns and intentions of developers in relation to big data and analytics. You can more on the methodology of the report here.

Key takeaways from the report include the following:

  • Software & computing (18%), financial (11.6%), manufacturing (10.9%) and retail (9.8%) industries have the highest percentage of programmers creating big data and analytics applications today.  Additional industries where big data app development is active and growing include entertainment (7.7%), telecommunications (7.5%), utilities & energy (6.6%) and healthcare (4.6%). The following graphic provides an overview of the industries addressed.

industries addressed

  • Capturing more information than traditional database practices (22.60%), capturing and analyzing unstructured data (21.10%) and the potential for visualizing or analysing data differently (20.70%) are the three top use cases driving app development today.  Evans Data found that capturing more information than traditional database practices allow increased 6% since last year, making it the top use case in 2015. The following graphic provides the distribution of responses by use cases from the developers surveyed.

top three use cases

  • Total size of the data being processed (40.8%), complex, unstructured nature of the data (38.1%) and the need for real-time data analysis (17.7%) are the top three factors driving big data adoption over traditional database solutions.  Evans Data found that the size and complexity of structured and unstructured data is the catalyst that gets enterprises moving on the journey to big data adoption. The ability to gain greater insights into their data with descriptive, predictive and contextually-driven analytics is the fuel that keeps big data adoption moving forward in all companies.

reasons to move to big data

  • 33.2% of all big data and advanced analytics developers are concentrating on the software & computing industry. Of these developers, 36.7% are working in organisations of 101 to 1,000 employees, 32.9% are in enterprises of 1,000+ employees, and 30.1% are in organisations of 100 employees or less. 42.6% of all big data software development in manufacturing begins in enterprises (1K+ employees).

Industries being targeted by big data by company size

 

  • Enterprises competing in the software & computing industry (17.5%), manufacturing (15.8%) and financial industry (14%) are investing the heaviest in big data and analytics app development. Overall, 32% of big data and analytics projects are custom-designed and produced by system integrators and value-added resellers (SI, VAR). 70% of big data and advanced analytics apps for manufacturing are created by enterprise and system integrator/value-added reseller (SI/VAR) development teams.  The following graphic provides an overview of industries targeted by big data, segmented by developer segment.

industries being targeted by big data by developer segment

 

  • Sales and customer data (9.6%), IT-based data analysis (9.4%), informatics (8.7%) and financial transactions (8.4%) are the most common big data sets app developers are working with today.  In addition marketing, system management, production and shop floor data, and web & social media-generated data are also included.  Evans Data found that informatics data sets grew the fastest in the last six months, and scientific computing is now competing with transaction processing systems as a dominant data set developers rely on to create new apps.

kinds of information that feed your company's data stores

  • Marketing departments have quickly become the most common users of big data and advanced analytics apps (14.4%) followed by IT (13.3%) and Research & Development (13%). Evans Data asked developers which departments in their organizations are putting big data and advanced analytics apps to use, regardless of where they were created.  38.2% of all big data use in organizations today are in customer-facing departments including marketing, sales, and customer service.

departments using analytics and big data

  • Availability of relevant tools (10.9%), storage costs (10.2%) and siloed business, IT, and analytics/data science teams (10.0%) are the top three barriers developers face in building new apps. It’s interesting to note that compliance and having to transition from legacy systems did not score higher in the survey, as these two areas are inordinately more complex in more regulated, older industries.  For big data and advanced analytics to accelerate across manufacturing and financial industries, compliance and legacy systems integration barriers will need to first be addressed.

three barriers

  • Quality of data (19.2%), relevance of data being acquired (13.5%), volume of data being processed (12.6%) and ability to adequately visualise big data (11.7%) are the four biggest problem areas faced by big data developers today.  Additional problem areas include the volume of data in storage (10.5%), ability to gain insight from big data (10.1%) and the high rate of data acquisition (7.6%).  The remainder of problem areas are shown in the graphic below.   

biggest problem

  • Providing real-time correlation and anomaly detection of diverse security data (29.9%) and high-speed querying of security intelligence data (28.1%) are the two most critical areas vendors can assist developers with today. Big data and analytics app developers are looking to vendors to also provide more effective security algorithms for various use case scenarios (17.6%), flexible big data analytics across structured and unstructured data (14.2%) and more useful graphical front-end tools for visualising and exploring big data (5.1%).

vendor provide

Tech News Recap for the Week of 10/12/2015

Were you busy last week? Here’s a quick tech news recap of articles you may have missed from the week of 10/12/2015.

Tech News Recap

Tech News RecapThe biggest news story last week was Dell purchasing EMC for $67 billion in the largest tech deal ever. Companies are switching from Google Apps back to Office 365. Chinese domestic DRAM and NAND flash consumption is dramatically increasing with the rise in popularity of Chinese PCs and smartphones.

  • Dell buys EMC in largest tech deal ever
  • Why companies are switching from Google Apps to Office 365
  • Cisco supplying SDN and NFV to Softbank
  • Top Windows 10 Apps To Boost Your Productivity
  • China to consumer nearly 30% of the world’s flash, 21% of DRAM
  • Google graveyard: What Google has killed off in 2015
  • 6 Tips to Ensure a Successful Wireless Project
  • Too many healthcare employees complacent about security
  • Fake LinkedIn profiles lure unsuspecting users
  • The Innovative Mindset Your Company Can’t Afford to Lose
  • Is There a ‘Holy Grail’ In The Cloud
  • The secret to first-rate mobile apps for customers? Iterate, iterate, iterate

If you’re looking for tips to ensure a successful wireless project, download this whitepaper. If you’d like expert insight on the VMware NSX vs. Cisco ACI debate, you can download this on-demand webinar.

 

By Ben Stephenson, Emerging Media Specialist

Tech News Recap for the Week of 10/12/2015

Were you busy last week? Here’s a quick tech news recap of articles you may have missed from the week of 10/12/2015.

Tech News Recap

Tech News RecapThe biggest news story last week was Dell purchasing EMC for $67 billion in the largest tech deal ever. Companies are switching from Google Apps back to Office 365. Chinese domestic DRAM and NAND flash consumption is dramatically increasing with the rise in popularity of Chinese PCs and smartphones.

  • Dell buys EMC in largest tech deal ever
  • Why companies are switching from Google Apps to Office 365
  • Cisco supplying SDN and NFV to Softbank
  • Top Windows 10 Apps To Boost Your Productivity
  • China to consumer nearly 30% of the world’s flash, 21% of DRAM
  • Google graveyard: What Google has killed off in 2015
  • 6 Tips to Ensure a Successful Wireless Project
  • Too many healthcare employees complacent about security
  • Fake LinkedIn profiles lure unsuspecting users
  • The Innovative Mindset Your Company Can’t Afford to Lose
  • Is There a ‘Holy Grail’ In The Cloud
  • The secret to first-rate mobile apps for customers? Iterate, iterate, iterate

If you’re looking for tips to ensure a successful wireless project, download this whitepaper. If you’d like expert insight on the VMware NSX vs. Cisco ACI debate, you can download this on-demand webinar.

 

By Ben Stephenson, Emerging Media Specialist

What is BPM? | @CloudExpo #DevOps #BPM #Microservices

A business process is any sequence of events or tasks that must be performed for a business to operate. For example, a customer’s purchase resulting in a delivery is a key business process that exists in all for-profit organizations. BPM is neither task management or project management (although it can occur within a project context). BPM is focused more on repetitive ongoing processes that follow a predictable pattern.

read more

ISV’s Realize the Value of SaaS for Older Applications

Guest blog by David Madison, Sr. Account Manager, ISV Alliances. This blog post has been reprinted with David’s permission from his LinkedIn blog. The original piece can be found here. I recently had a conversation with one of our top ISV clients, which is one of the largest SCM software companies in the world. Since […]

The post ISV’s Realize the Value of SaaS for Older Applications appeared first on Parallels Blog.

Safe Harbour struck down: Will smaller European cloud providers step into the breach?

(c)iStock.com/FrankRamspott

On October 6, the European Union’s highest court struck down a transatlantic pact used by thousands of companies to transfer Europeans’ personal information to the US.

The pact known as Safe Harbour was introduced over 15 years ago and it allows companies and countries outside the EU to declare that they adhere to the stricter privacy and data protection rules set by the European Union. Striking down the Safe Harbour arrangement came in light of recent evidence that foreign entities claiming to adhere to EU standard data protection cannot actually meet the standard when it clashes with the foreign governments’ interests in national security.

This news created speculation about the methods in which the big data companies will get around this ruling. What is clear though is that the European High Court identified an adverse discrepancy in the way personal data is protected in the US versus the EU. UK customers, be they individuals or businesses, need to evaluate the importance they place on securing their data or that of their respective customers, and realise that using foreign companies, albeit large and well known international providers, is viewed by the European courts as potentially compromising that data.

We are all aware that any electronically stored information is at risk of being illegally hacked or compromised, but the court ruling was not relating to the quality of cyber security that companies employ, but to the risk posed by foreign government which may have the right to demand from data providers access to data including that of UK individuals or businesses.

A suitable analogy in the physical world might be comparing between two storage houses. Let’s say both had a burglar alarm and doors and windows secured with appropriate locks. They still both have a risk of burglary. Moreover, both centres would need to let the law enforcement agents inspect the premises if they had a proper court order given on sound grounds.

However, what if one of the centres was located in a jurisdiction where the law enforcement agents didn’t require a court order to enter, what if they just had the key and can roam around freely without even saying why there were there or indeed that they were there in the first place. Now what if the law enforcement wasn’t only the police, but a multiple of unknown government branches? Which storage house would you feel is more secure, the one that needs a court order to enter, or the one where the key is sitting with multiple government agencies?

The same comparison applies to the online world and the European court has recognised that. Storing files or using email provided by a non EU company means that the company doing so is not only breaching security, it might be welcoming the breach through an open front door.

It will now be interesting to see whether the ruling will be viewed merely as a technicality to be circumvented by big companies or will it be seen as a real warning sign and a catalyst for businesses to use smaller European cloud service providers which solely use European data centres and are subject only to European data protection laws.

What’s New in CA APM 10.1 | @CloudExpo #APM #Microservices

Microservices architecture compartmentalize the application by function allowing for greater application flexibility, portability and an increase in update/changes. This architecture introduces new layer of monitoring challenges to an already complex application environment. The strides and enhancements we made in CA APM 10 with APM Team Center Perspectives, Timeline views and Differential Analysis has helped us to make strides in solving these challenges of monitoring microservices that include:

read more

DevOps and Containers By @Siruslan | @DevOpsSummit #Microservices

Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and containers together help companies achieve their business goals faster and more effectively.
In his session at DevOps Summit, Ruslan Synytsky, CEO and Co-founder of Jelastic, will review the current landscape of DevOps with containers and the benefits. In addition, he will discuss known issues and solutions for enterprise applications in containers.

read more

DevOps Continuous Testing | @DevOpsSummit @Spirent #Microservices

Everyone talks about continuous integration and continuous delivery but those are just two ends of the pipeline. In the middle of DevOps is continuous testing (CT), and many organizations are struggling to implement continuous testing effectively. After all, without continuous testing there is no delivery. And Lab-As-A-Service (LaaS) enhances the CT with dynamic on-demand self-serve test topologies. CT together with LAAS make a powerful combination that perfectly serves complex software development and delivery pipelines. Software Defined Networks (SDNs) turns the network into a flexible configurable system of software components and connections that is powerful but presents new complexities and challenges for network software development, delivery and deployments.

read more