{"id":16609,"date":"2015-08-13T09:35:57","date_gmt":"2015-08-13T09:35:57","guid":{"rendered":"http:\/\/www.businesscloudnews.com\/?p=232821"},"modified":"2015-08-13T09:35:57","modified_gmt":"2015-08-13T09:35:57","slug":"google-microsoft-punt-big-data-integration-services-into-ga","status":"publish","type":"post","link":"https:\/\/icloud.pe\/blog\/google-microsoft-punt-big-data-integration-services-into-ga\/","title":{"rendered":"Google, Microsoft punt big data integration services into GA"},"content":{"rendered":"<div id=\"attachment_164491\" style=\"width: 310px\" class=\"wp-caption alignright\"><a href=\"http:\/\/www.businesscloudnews.com\/files\/2013\/11\/Database.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-164491\" src=\"http:\/\/www.businesscloudnews.com\/files\/2013\/11\/Database-300x225.jpg\" alt=\"Big cloud incumbents are doubling down on data integration\" width=\"300\" height=\"225\" \/><\/a><\/p>\n<p class=\"wp-caption-text\">Big cloud incumbents are doubling down on data integration<\/p>\n<\/div>\n<p>Google and Microsoft have both announced the general release of Cloud Dataflow and Azure Data Factory, their respective cloud-based data integration services.<\/p>\n<p>Google\u2019s Cloud Dataflow is designed to integrate separate databases and data systems \u2013 both streaming and batch \u2013 in one programming model while giving apps full access to, and the ability to customise, that data; it is essentially a way to reduce operational overhead when doing big data analysis in the cloud.<\/p>\n<p>Microsoft\u2019s Azure Data Factory is a slightly different offering. It\u2019s a data integration and automation service that regulates the data pipelines connecting a range of databases and data systems with applications. The pipelines can be scheduled to ingest, prep, transform, analyse and publish that data \u2013 with ADF automating and orchestration more complex transactions.<\/p>\n<p>ADF is actually one of the core components of Microsoft\u2019s Cortana analytics offering, and is deployed to automate the movement and transformation of data from disparate sources.<\/p>\n<p>The maturation and commoditisation of data integration and automation is a positive sign for an industry that has for a very long while leaned heavily on expensive bespoke data integration. As more cloud incumbents bring their own integration offerings to the table it will be interesting to see how some of the bigger players in data integration and automation, like Informatica or Teradata, respond.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Google and Microsoft have both announced the general release of Cloud Dataflow and Azure Data Factory, their respective cloud-based data integration services.<\/p>\n","protected":false},"author":105,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3236,156,3237,656,344,51,1976],"tags":[],"class_list":["post-16609","post","type-post","status-publish","format-standard","hentry","category-azure-data-factory","category-big-data","category-cloud-dataflow","category-database","category-google","category-microsoft","category-news-analysis"],"_links":{"self":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/16609","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/users\/105"}],"replies":[{"embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/comments?post=16609"}],"version-history":[{"count":1,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/16609\/revisions"}],"predecessor-version":[{"id":16610,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/posts\/16609\/revisions\/16610"}],"wp:attachment":[{"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/media?parent=16609"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/categories?post=16609"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/icloud.pe\/blog\/wp-json\/wp\/v2\/tags?post=16609"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}