Kubernetes Powered Central Go Modules | @KubeSUMMIT @JFrog @LeonStigter #Serverless #Containers #Docker #Kubernetes

Today, Kubernetes is the defacto standard if you want to run container workloads in a production environment. As we set out to build our next generation of products, and run them smoothly in the cloud, we needed to move to Kubernetes too! In the process of building tools like KubeXray and GoCenter we learned a whole bunch.

Join this talk to learn how to get started with Kubernetes and how we got started at JFrog building our new tools. After the session you will know:
How we got to Kubernetes (and why we chose it)

read more

Built in Docker Containers | @DevOpsSUMMIT @DataTheorem #DevOps #Serverless #Containers #Docker #AWS #Lambda #Kubernetes

In 2017, Docker reached 24% adoption while Lambda reached 23.5% adoption among Amazon Web Services customers. Yet, the adoption rate of serverless and cost savings are dramatically better than what virtual containers can offer. Amazon, Google, and Microsoft are all pushing serverless because it’s easier and cheaper for their customers. Also, once apps are built using serverless frameworks, there’s a higher switch-over cost to go from one cloud to another. We’ll discuss this and also talk about how brand loyalty is something every subscription service is hoping to achieve. Amazon, Google, and Microsoft are strengthening their offerings with serverless in the cloud.

read more

Shortcomings of ETL Tools | @CloudEXPO @Infostretch #Cloud #CIO #BigData #Analytics #AWS #Serverless #DataCenter

Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.

Extract, transform and load (ETL) tools like AWC Glue bring much needed functionality. This tool enables new approaches to pulling, processing and pushing data from source to target, and introduces concepts such as performing data transformation tasks using SparkSQL scripts in Apache spark environment. However, there are shortcomings with AWS Glue, leading to a number of challenges and questions:

read more

How to Sponsor @CloudEXPO Silicon Valley | #Cloud #AI #CIO #Serverless #DevOps #DataCenter #Kubernetes #IoT #Blockchain

At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throughout enterprises of all sizes.

read more

Microservices Implementation at Scale | @KubeSUMMIT @Capgemini @CapgeminiNA #CloudNative #Serverless #Kubernetes #Microservices

We at Capgemini have developed a cloud-native PaaS Solution called «Apollo». Apollo is built on top of following open source components. – Apache Mesos for cluster management, scheduling & resource isolation – Marathon or Kubernetes for Container orchestration – Docker for application container runtime, – Consul for service discovery via DNS – Weave for networking of Docker Containers – Traefik for application container load balancing

read more

Kubernetes Powered Central Go Modules Repository | @KubeSUMMIT @JFrog @LeonStigter #DevOps #Serverless #Kubernetes

Today, Kubernetes is the defacto standard if you want to run container workloads in a production environment. As we set out to build our next generation of products, and run them smoothly in the cloud, we needed to move to Kubernetes too! In the process of building tools like KubeXray and GoCenter we learned a whole bunch.

Join this talk to learn how to get started with Kubernetes and how we got started at JFrog building our new tools. After the session you will know:

How we got to Kubernetes (and why we chose it)

read more

How to Build Maintainable Serverless Architecture | @KubeSUMMIT @SignalFX #CloudNative #Serverless #DevOps #Docker #Kubernetes

Using serverless computing has a number of obvious benefits over traditional application infrastructure – you pay only for what you use, scale up or down immediately to match supply with demand, and avoid operating any server infrastructure at all.

However, implementing maintainable and scalable applications using serverless computing services like AWS Lambda poses a number of challenges. The absence of long-lived, user-managed servers means that states cannot be maintained by the service. Longer function invocation times (referred to as cold starts) become very important to track, because they impact the response time of the service and will impose additional cost. Additionally, the transition to smaller individual components (much like breaking a monolithic application into microservices) results in a simpler deployment model, but makes the system as a whole increasingly complex.

read more

How DevOps professionals are struggling with the daily troubleshooting grind

If your organisation is either focusing on DevOps or employs plenty of developers, make sure you keep an eye on their workloads – or face an exodus.

That’s the primary finding from IT management software provider SolarWinds. In its latest report, which polled 336 DevOps, developer and web product manager professionals (WPMs) in the US and Canada, many workers across sectors are fed up with troubleshooting being the mainstay of their daily work.

Troubleshooting remained the most disliked component of their roles, and respondents warned that if they had to continue doing it without any signs of job advancement, they would leave their current jobs. Almost half (48%) of those polled said troubleshooting app issues was one of their three most regular tasks, while this number went up (53%) for DevOps respondents who cited it as the most frequent task.

On average, DevOps and WPMs spend less than a quarter of their time proactively optimising performance of their environments. This may be bad enough, but less urgent, more long-term tasks are being put aside. Without troubleshooting, the research argues, professionals would be able to prioritise building product roadmaps, or managing and deploying apps.

“Today’s technology professionals play an unquestioned role in driving innovation for their businesses. Application development and the end user’s experience are inextricable from business growth,” said Joe Kim, SolarWinds EVP and global chief technology officer. “Yet this survey shows this push towards innovation is minimised in favour of reactive troubleshooting tasks, which are growing due to the need for comprehensive monitoring and visibility into these applications.

“Tech professionals need to be armed with comprehensive tools that enhance visibility into cloud applications and enable them to spend less time monitoring and troubleshooting, and more time creating opportunities to move their businesses and careers forward,” added Kim. “Otherwise, businesses run the risk of a demotivated DevOps team.”

As regular readers of this publication will recognise, a cultural change is necessary in order to get DevOps initiatives off the ground. Writing for CloudTech in December, Annie Andrews, head of technology at Curo Talent, noted the disparity. “The goal of DevOps is to help deliver software quickly, robustly and efficiently. However, it is often misinterpreted as simply a need to deploy new technological tools to meet this goal,” wrote Andrews. “In practice, DevOps relies more on cultural acceptance than the integration of new tools.

“Of course, the organisation change can be supported by a collection of improved software development practices, but organisations cannot rely only on these tools,” Andrews added. “Ultimately, it starts with a change to people’s mindsets.”

You can read the full report here (email required).

https://www.cybersecuritycloudexpo.com/wp-content/uploads/2018/09/cyber-security-world-series-1.pngInterested in hearing industry leaders discuss subjects like this and sharing their experiences and use-cases? Attend the Cyber Security & Cloud Expo World Series with upcoming events in Silicon Valley, London and Amsterdam to learn more.

The power of anonymous data

4 Feb, 2019

A popular phrase usually found alongside “big data” is “smart city”. This is because a large conurbation with hundreds of thousands or millions of inhabitants will be a significant source of data, and could also greatly benefit from the effective analysis of that data. Traffic information from city dwellers’ use of personal vehicles and public transport is just the beginning. The sheer volume of people habitually found in a given location can help city planners manage resources, assist retailers to know where they can most effectively place outlets, when to open them, and much more.

One of the most significant sources of this information is the smartphone. In figures cited by Consultancy.uk, Deloitte has claimed that, in 2017, 85% of the UK population owned smartphones, and this figure has been increasing every year. A smartphone is packed with sensors and connects to external ones as well. It knows our location, is increasingly the conduit for our travel and retail transactions, and forms the hub of our social interaction. This makes it the perfect device to supply the big data for a smart city.

But smartphone users are becoming increasingly uncomfortable with the amount of data their devices collect about them, and who it is being shared with. Even when we are sure where our data is being sent, we still worry that big corporations know too much about where we are going and what we’re doing when we get there.

Although it’s very easy to see these kinds of news stories as a valid impetus to restrict all our data from being shared with anyone, this will be preventing some of the most significant advancements afforded by contemporary technology. The benefits for our lifestyles and work needs can be very real. The data collected doesn’t have to be directly linked to specific individuals, and in fact some of the greatest potential can be available from looking at the trends found in large aggregations with no need to drill down to individual records.

The key word here is “anonymous”. Your data can be separated from your identity, so you become merely one sample amongst millions that are grouped under categories such as demographics. For example, O2’s Smart Steps uses anonymised, aggregated smartphone geolocation data from over 24.5 million O2 mobile network customers to track the number of people who visit a location. All of the data collected by Smart Steps is secure, anonymous and aggregated so no personal information can be extracted. Whilst anonymous, if its customers have recorded their preferences, it can be referenced by time, gender and age. It can also track where its users have come from and where they are going, using data that spans back to 2013.

Without needing to know who individuals are, this kind of information can pay huge dividends. O2’s Smart Steps has been harnessed to tap into real-time and historical data on over 100 daily journeys to help one company to advise clients much more accurately and quickly than when they were using their previous data collection methods. This helps clients decide whether to go ahead with airport, building, road or high-speed rail schemes, saving four months of work on a typical 16-month project. Thus the planning of city infrastructure can be much smarter and faster than before, with adjustments according to where people actually go in their daily lives.

A lot of information is available without needing to identify individuals. Records may be tagged with an ID, but this will still be securely separated from which user it is referring to. There are benefits from this, as it can provide details about whether visitors to a location are newcomers or returning, and when they come. Shops can work out whether their marketing is working to bring in new customers, and at what times to employ more retail staff to cope with demand. This is likely to be of benefit to the customers as much as the retailer, since the former won’t find themselves stuck in check-out queues or unable to find an assistant to help them because the shop is too busy, and the latter will be able to better manage their people.

However, there are also potential benefits that are more directly targeted at the individual, without specifically requiring them to part with their anonymity. Where historical mass travel data can make public development schemes smarter and more finely targeted, retailers can use similar generalised real-time data to plan the best times and places to offer discounts – either to attract customers to an underutilised outlet, or reach them where and when they are gathering in large numbers, such as a shopping mall or venue with associated restaurants. They can then track the effectiveness of these endeavours.

This concept gains particular power when end users don’t have to wade through a massive list of offers, many of which aren’t relevant to their tastes or current location. O2 Priority, for example, uses geo-location to present offers and savings that are tailored to where the customer currently is, making them more relevant and likely to be of benefit. Especially if the customer has also registered what’s important to them.

The offers are essentially tailored to your lifestyle as you travel. For example, you might be attending a concert at the O2 Arena, so Priority presents a selection of restaurants near the venue that are currently offering discount deals. This isn’t an intrusive system like the personalised advertising shown in science fiction movies such as Minority Report. People choose to be alerted, and can also access the service purely on demand.

This really is just the tip of the iceberg of what is possible when you allow your smartphone to share information with aggregators that apply the necessary, regulatory safeguards to anonymise your data. Real-time traffic details derived from smartphone locations can help route drivers away from congestion. Dynamic variable speed limits can react to smooth out flow ahead of a bottleneck. Environmental controls in enclosed public spaces can be adjusted to suit the volume of people visiting. So long as customers can be assured that their data will not be abused, and will remain anonymous when requested, the power available to manage city life more smartly can be huge.

Discover how O2’s technology is helping businesses empower their workforce.

Serverless Apps Three Key Use Cases | @KubeSUMMIT @Platform9Sys #Serverless #Containers #DevOps #Docker #Kubernetes

Serverless applications increase developer productivity and time to market, by freeing engineers from spending time on infrastructure provisioning, configuration and management. Serverless also simplifies Operations and reduces cost – as the Kubernetes container infrastructure required to run these applications is automatically spun up and scaled precisely with the workload, to optimally handle all runtime requests.

Recent advances in open source technology now allow organizations to run Serverless and Kubernetes reliably, at scale, also on on-premises and private cloud infrastructure. The ability to achieve the benefits of Serverless on existing infrastructure – and not having to rely solely on public clouds – has greatly increased the adoption of Serverless across industries, including financial services, IoT, retail, healthcare, and more.

Serverless offers an incredible opportunity for business accelerate innovation and reduce operational costs – both for green field applications, as well as for established organizations with legacy applications and technical debt.

read more