Category Archives: Google

cloud logging, Google, News & Analysis, operations management, Vendor

Google adds log analysis to cloud platform

Google is giving enterprises more tools to troubleshoot persnickety workloads and apps

Google is giving enterprises more tools to troubleshoot persnickety workloads and apps

Google has added a service enabling users of its cloud platform to analyse data logs from both Compute Engine and App Engine, which the company said would help users optimise management operators.

Google already offers a cloud monitoring tools that gives enterprises visibility into networking and compute resources associated with their instances (the company acquired these capabilities from Stackdriver last year), but much more can be gleaned from the massive number of logs that workloads generate – particularly when investigating consistent service errors.

That’s where the cloud logging service comes into play, enabling users of Google’s cloud services to view, analyse and export log data in real time.

“Businesses generate a staggering amount of log data that contains rich information on systems, applications, user requests, and administrative actions. When managed effectively, this treasure trove of data can help you investigate and debug system issues, gain operational and business insights and meet security and compliance needs,” explained Deepak Tiwari, product manager at Google in a recent blog post.

“But log management is challenging. You need to manage very high volumes of streaming data, provision resources to handle peak loads, scale fast and efficiently and have the capability to analyse data in real-time,” he said.

A number of Google’s rivals (Microsoft, AWS) already offer log analysis tools for cloud service users but Google said its tool, which is currently in beta (and free for the time being), comes pre-integrated with a number of its services (BigQuery for analysis, Google Cloud Storage for longer term log data storage) and can be deployed quickly.

Cloud Services, Cloud Storage, Google

Nearline: Google’s Low-Cost Cloud Storage Service For Cold Data

Google is launching a new cloud storage service that is expected to change how many companies of any size view online storage. Google Cloud Storage Nearline allows businesses to store data they or their customers do not often need, and for a low cost of $0.01 per gigabyte at rest.

 

Unlike other cloud storage services where it can take very long to retrieve your data, Google promises that on Nearline your data will be available in only three seconds. They believe the gap between the cost of online and offline storage must decrease according to their director of product management for the Cloud Platform team, Tom Kershaw.

 

Businesses may need or want to keep all of their records for as long as possible. Once they have been moved offline however, it becomes difficult to quickly find the desired record. Google is hoping to blue the line between cold storage and online storage so that businesses do not have to delete or move their files to more complicated storage locations.

 

The low cost of this storage service, which is competitive with Glacier by Amazon, is due to the fact that Google is able to host all of its data on a single system, regardless of location. This is unusual for a cloud storage service because historically, service providers have built two separate systems. The hardest thing about offline storage is transferring the data between these two systems.

 

Nearline uses the same system as the rest of Google’s storage products, including the same encryption and security features. They also share API’s with the standard storage service. It is expected that early adopters of this service will use it primarily for photo, video and document storage.

 

In order to reach a broader market, Google has partnered with many storage companies, most notable Iron Mountain. This partnership will allow users to send in their hard drives and have the securely uploaded onto Nearline.

iron mtn

The post Nearline: Google’s Low-Cost Cloud Storage Service For Cold Data appeared first on Cloud News Daily.

Amazon AWS, Amazon Web Service, DropBox, Google, Google Drive, Microsoft, New Relic, Splunk

Amazon AWS Moving ‘Up the Stack’ to Applications

Amazon Web Services has entered the applications end of the cloud world with several recent releases:

  • Log monitoring and admin with Logs for CloudWatch
  • Collaboration and file sharing with Zocalo
  • Mobile application development with Cognito, Mobile Analytics and a new Mobile SDK

Logs for Cloudwatch works with the AWS CloudWatch network monitoring console to collect log file activities which can then be stored and analyzed in AWS Kinesis. The new tool automatically moves logs from instances and aggregates them into a central service where exceptions can be set directly on those applications.

Third-party products already that, and companies like Splunk, Logentries, and New Relic , which launched its new Insights real-time analytics tool just hours before the AWS news, will all be watching this very carefully (probably also very nervously).

The new AWS Zocalo collaboration/file-sharing plans are further proof that Amazon knows it must be a broad platform player to compete against two mega platform rivals – Google and Microsoft, as well as two younger, well-funded but more limited contenders in Dropbox and Box. Zocalo thus targets Google Drive and Microsoft OneDrive, which are part of a much bigger portfolio of end-user products at those companies.

Cloud & IT Management, Cloud computing, Free, Google, Google App Engine, Kubernetes, LXC, Open Source, Tools

Google Adds Docker Image Support to App Engine, Announces Kubernetes Container Manager

Google continues to up the cloud ante by adding a set of extensions that allow Google App Engine developers to build and deploy Docker images in Managed VMs. Developers can use these extensions to easily access the large and growing library of Docker images, and the Docker community can easily deploy containers into a completely managed environment with access to services such as Cloud Datastore.

From the Google Cloud Platform Blog:

“Based on our experience running Linux containers within Google, we know how important it is to be able to efficiently schedule containers at Internet scale. To that end, we’re announcing Kubernetes, a lean yet powerful open-source container manager that deploys containers into a fleet of machines, provides health management and replication capabilities, and makes it easy for containers to connect to one another and the outside world. We’ll continue to build out the feature set, while collaborating with the Docker community to incorporate the best ideas from Kubernetes into Docker.”

 

Full details here.

Cloud & IT Management, Cloud computing, Docker, Free, Google, Google App Engine, Kubernetes, LXC, Open Source, Tools

Google Adds Docker Image Support to App Engine, Announces Kubernetes Container Manager

Google continues to up the cloud ante by adding a set of extensions that allow Google App Engine developers to build and deploy Docker images in Managed VMs. Developers can use these extensions to easily access the large and growing library of Docker images, and the Docker community can easily deploy containers into a completely managed environment with access to services such as Cloud Datastore.

From the Google Cloud Platform Blog:

“Based on our experience running Linux containers within Google, we know how important it is to be able to efficiently schedule containers at Internet scale. To that end, we’re announcing Kubernetes, a lean yet powerful open-source container manager that deploys containers into a fleet of machines, provides health management and replication capabilities, and makes it easy for containers to connect to one another and the outside world. We’ll continue to build out the feature set, while collaborating with the Docker community to incorporate the best ideas from Kubernetes into Docker.”

 

Full details here.

Advertising, Box, DropBox, File Sharing, Filesharing, Google, Google Adword, Intralink

How an Adwords Campaign Accidentally Exposed Dropbox and Box User’s Confidential Files

We previously reported on a Dropbox Security Snafu (and their correction for it). Now we’re learning more about how it came about, and how it was discovered.

There are several ways users can inadvertently leak confidential files, but the one that is the real head-scratcher is a combination of a user entering the URL of a Dropbox or Box file-sharing link in their browser’s “search box” rather than the “URL box”, combined with Google AdWords campaigns by competitors who want their ads to appear with people “search” for Dropbox or Box (pretty standard stuff).

The sites running such a campaign then — completely innocently — see what users are searching for, and what they are “searching for” turns out to be fully-clickable URLs to files that often contain sensitive personal or company data.

If you think that’s too rare a scenario to worry about, think again:

In one short and entirely innocently designed ad campaign alone, we found that about 5 per cent of hits represented full links to shared files, half of which required no password to download. This amounted to over 300 documents from a small campaign, including several tax returns, a mortgage application, bank information and personal photos. In one case, corporate information including a business plan was uncovered.

That’s from Richard Anstey of Intralink, the people who stumbled on the issue.

Look at this to see (redacted) images of one person’s tax return, and another’s mortgage application. Identity theft, anyone?

Read more about how Intralink discovered all this, along with some good advice on protecting yourself.

TL;DR: sensitive file? Use a sharing application that offers a password or PIN option.

Amazon, Amazon AWS, Cloud computing, Data center, Google

Amazon, Google: a Battle to Dominate the Cloud

The cloud is just a vast mass of computers connected to the internet, on which people or companies can rent processing power or data storage as they need it.

All the warehouses of servers that run the whole of the internet, all the software used by companies the world over, and all the other IT services companies hire others to provide, or which they provide internally, will be worth some $1.4 trillion in 2014, according to Gartner Research—some six times Google and Amazon’s combined annual revenue last year.

When that time comes, all the world’s business IT needs will be delivered as a service, like electricity; you won’t much care where it was generated, as long as the supply is reliable.

Way back in 2006, Amazon had the foresight to start renting out portions of its own, already substantial cloud—the data centers on which it was running Amazon.com—to startups that wanted to pay for servers by the hour, instead of renting them individually, as was typical at the time. Because Amazon was so early, and so aggressive—it has lowered prices for its cloud services 42 times since first unveiling them, according to the company—it first defined and then swallowed whole the market for cloud computing and storage.

Even though Amazon’s external cloud business is much bigger than Google’s, Google still has the biggest total cloud infrastructure—the most servers and data centers. Tests of Amazon’s and Google’s clouds show that by one measure at least—how fast data is transferred from one virtual computer to another inside the cloud—Google’s cloud is seven to nine times faster than Amazon’s.

The question is, is Amazon’s lead insurmountable?

 

Amazon AWS, Amazon Web Services, Cloud computing, Google, Microsoft, Microsoft Office, Opinion

A Big, Perhaps Watershed Week of Cloud Annoucements

  • Google harmonized its cloud computing business to a single entity, with a pricing model intended to hold customers by enticing them to build ever cheaper and more complex software. 
  • Cisco announced it would spend $1 billion on a “cloud of clouds” project. 
  • Microsoft’s new CEO made his first big public appearance, offering Office for the Apple iPad, partly as a way to sell more of its cloud-based Office 365 product.
  • Amazon Web Services announced the general release of its cloud-based desktop computing business, as well as a deal with to offer cloud-based enterprise software tools to industries like healthcare and manufacturing.

For more detail and opinions read this, and listen to this.

Collaboration, Document Management, DropBox, File Sharing, Google, Google Drive, Java, Microsoft, My Docs Online Desktop App, QuickBooks, SkyDrive, Web Folders, WebDav

Three App Strategies for Document Collaboration, When To Use Each

When you have a document or file which needs editing or updating by more than one person, in more than one place, controlling the process to avoid the dreaded “intervening update” problem can be a challenge.

In the early days of personal computers the answer was often the “sneakernet”. Create document or file, write to a diskette, put on your Chuck Taylors and walk it to your collaborator, then get it back the same way. Later, LAN technology allowed the file to be placed on a local server and opened across the LAN for editing, with a lock on the file at the server while editing is being performed. When needing to get beyond the local LAN email attachments could be used, or FTP if you had a pre-Web internet connection. Management of “check-in/check-out” and  resolving update conflicts was done by humans, not software.

Sounds like the stone age now, but it beat printing a document and editing with a red pen.

The advent of the Web and its browsers, along with widespread, always-on internet connectivity brought new opportunities for using that connectivity and various software design strategies to support collaboration.

There are three essential design strategies for addressing the problem: pure web app (think Google Drive, née Google Docs),  file syncing (think Dropbox), and local editing with central locking (think MS Office+Web Folders/WebDAV). Each has its pros and cons, and which approach will work for a given task depends on factors like file type, file size, editing feature set, and client platforms supported.

The Pure Web App Approach

A real web app runs in a browser using javascript and (more and more often) HTML5. This approach in theory can support any device that has a modern browser, including tablets and smartphones, as well as Macs, Windows PCs and Chromebooks. Perhaps the premier example of this approach is the applications available in Google Drive. Simple documents, spreadsheets, presentations, and drawings can be created, edited and shared easily. Collaboration is as close to instantaneous as networking technology allows. Documents are always in synch. The first time you co-edit a word processing document with a colleague on the other side of the world, and you see  edits in real time, you should pause for a moment and marvel at how amazing this technology is.

That’s the good. The bad includes:

  • Google buy-in (or buying into some other platform).
  • Limited document/file type support. Although you can now upload and download any type of file to Google Drive, you have to convert to a Google format to edit online. You won’t be editing Quickbooks files, for example.

This is using Google as an example. There are other services using the web app approach. SkyDrive from Microsoft for example, or Quickbooks Online from Intuit. The bottom line is all these online apps have limitations, never mind cost (Quickbooks Online costs between $12.95 to over $70 per month).

The File Synchronization Approach

File synchronization apps like Dropbox work by running applications on all your devices, with a special folder that communicates with their servers to propagate new and updated files to other devices. This works well when the only person involved is you, and you have multiple devices (work desktop, laptop, home PC, and sometimes mobile devices). Another plus is the ability to synchronize a wide variety of file types. Each device that will be used to edit or update a file or document will need the appropriate application installed on the device, and all copies or versions of the aforementioned application must be able to handle the internal format of the particular file. For instance, Quickbooks file formats for Windows and Macs are incompatible.

The typical problem for apps using the file synch approach is lack of “file locking” to keep two people from updating a file at the same time. Some file sync apps attempt to resolve intervening updates but usually with little success.

The Local Editing With Central Locking Approach

Server-based file locking apps keep the file on a central server, and use specialized server plus client applications to do the following each time a file needs to be edited or updated:

  • “Lock” the file on the server to tell other copies of the special client application that the file is “checked out” for update by someone else.
  • Download the file to a client application on a PC, Mac, or other supported platform (usually as a “temp” file).
  • Open the correct application for editing.

After editing the process is reversed:

  • File is saved locally in the temporary location.
  • File is uploaded back to the central server, where it replaces the old copy.
  • The “Lock” is removed so other users can take their turn at editing.

It is also a good idea for this approach to offer a “View Only” or “Read Only” copy of a locked file for others to look at (but not edit).

An early example of this approach is WebDAV (DAV stands for “Distributed Authoring and Versioning”). Microsoft refers to its WebDAV support in Windows as “Web Folders”, and supports locks and editing in Office applications such as Word and Excel. The problem with WebDAV and Web Folders is that virtually no other applications other than Office have implemented support for WebDAV locks.

A more general application that can support almost any file type while also supporting central file locking is available from My Docs Online via their java-based Desktop App. The Desktop App uses a “Lock & Open” to lock the file on the central server, downloads the file to a temporary location on the PC or Mac, and then launches the right application based on the file extension. When the editing session is complete the file is saved and closed locally, and then the user does a “Save & Unlock” in the Desktop App to send the updated file back to the server and release the lock.

The ability to support virtually any file type is a strong benefit of this design.

Potential issues with the approach include “network latency”. The bigger the file the longer it takes to download and open the locked copy, or sent it back to the server. The use of Java brings support for multiple operating systems, including all versions of Windows or Mac OS X, but does require Java be installed and kept up to date on the machine.

Choosing an App Whose Design Strategy Meets Your Needs

Which approach will work best for you? It depends on particular needs, and you may need more than one solution depending on particular file types or business processes involved.

If you and all your collaborators already have Google accounts, and if the goal is collaboration on a reasonably basic document or spreadsheet, it’s hard to beat Google Drive. If you mostly use Office, then SkyDrive might be a good fit, and so on. Consider a two-step approach, where, as an example, you use Google Drive to do the early drafts of a document when collaboration needs are heaviest, and then export to a more powerful desktop application for final production.

If your collaboration needs don’t require editing by multiple people, but mostly involve pushing updated versions of files and documents for viewing and reviewing, then a file synchronization app like Dropbox could work well.

If you are using specific file types like Quickbooks, CAD, as well as Excel, Word, or OpenOffice formats, and you need to let multiple people in multiple locations edit without fear of wiping out the edits of a colleague, consider an application like the My Docs Online Desktop App.