Google Cloud Platform to Include New Suite of DevOps Tools for Enterprise & SMEs
Google hosted their premier industry event for cloud software developers, data center technicians, and IT-driven businesses with the Google Cloud Next '18 conference at the Moscone Center in San Francisco this June. With over 100 key announcements made at the three day convention led by Google's executive management and senior engineering talent, thousands of people packed the facilities and hundreds of thousands more tuned in to watch the seminars via livestream.
One of the major developments was the announcement of a new Google Cloud Services Platform that combines Kubernetes, Istio, Apigee integration, and Stackdriver into a suite of tools that developers can use to manage apps in production either on GCP, multi-cloud architecture, or on-premises in private data centers. The Google Cloud Services Platform (GCSP) will also include new advanced support for "serverless" solutions using any programming language with containers in Kubernetes orchestration based on the Knative framework. The key aspect of GCSP is a dashboard metrics and analytics system using Istio + Stackdriver that graphs the microservices in use by an application, as well as the relations between them, in real-time with diagrams that show problems on production servers, errors in source code, or unexpected latency issues in response times. GCSP is fully supported by Google Container Engine (GCE) to deploy apps across multiple data centers internationally on cluster servers that scale according to the user traffic demand like AWS EC2. Weston Hutchins (Google Product Manager) and Eyal Manor (VP of Engineering at Google) introduced the new Cloud Services Platform with Kubernetes & Knative at the conference, while Kip Compton (SVP at Cisco Cloud Platform) spoke on developing open source multicloud/microservice solutions with Istio. A new Marketplace was also introduced for Google Kubernetes Engine (GKE) allowing third-party developers to publish software code with unified licensing & billing for online businesses using their tools.
Google Cloud Next 2018 - Day 1 Keynote: "Building a Cloud for Everyone"
The Day One Google Cloud Next Keynote was led by Google Cloud CEO Diane Greene who discussed the focus the company has placed on security in data center operations for enterprise corporations, such as the introduction of the Titan chip. For example, the use of ChromeBooks with G Suite has been proven to stop 99.9% of malicious attacks on desktop/laptop systems. AI was presented as the key to re-engineering businesses for the 21st century, with "AI in everything" a recurring theme at the company. Google Cloud services were promoted as the best place for software development using automation tools and open source solutions, with Google contributing to over 2,000 open source projects such as TensorFlow and Kubernetes. Quantum computing, IoT, & healthcare are major focuses for Google engineers currently, allowing them to develop partnerships with other enterprise corporations such as Target, Cisco, Salesforce, SAP, Accenture, & Deloitte. In total, Google has over 12,000 major industry partners that they are working with in enterprise, with the outstanding need for talent, training, recruitment, and certifications being provided by their staff engineers. AutoML was presented as the future of AI/ML/DL where businesses can build upon established algorithmic models for training data sets from their own information without compromising privacy, security, or proprietary trade secrets.
Sundar Pichai, the CEO of Google, also spoke on Day One, discussing the company's mission to organize the world's information and to make it accessible/useful to people across all sectors of society. Open platforms with shared technology were promoted by Pichai as a means for better ideas to take root in practical applications much faster, with Android being cited as a key example. Android started with just one manufacturer for devices in 2008 where now there are over 1300 different brands making consumer electronics using the software. Kubernetes, which emerged from Google's data centers, was touted as a primary example of the success of open source solutions, as it has scaled to massive industry uptake in just a few years. TensorFlow is another open source platform that allows businesses and other organizations such as academics using high performance computing tools to rethink and re-imagine new products and solutions using Google's "AI first" approach.
Urs Hölzle (SVP of Technical Infrastructure at Google) presented on Google Cloud's almost unlimited capacity to compute resources on the world's biggest network using Spanner, ML APIs (speech, vision, translation, etc.), BigQuery, and other software tools. Velostrata now allows businesses of any size to migrate their apps to Google Cloud in minutes. Hölzle suggested that cloud computing has been missing utilities for integrating a combination of on-premises, hybrid, & multi-cloud solutions, whereas 80% of enterprise corporations have already implemented a hybrid or multi-cloud strategy. Containers were presented as a means to help and simplify this problem, with Kubernetes offering a better way to organize microservices using load balancing & auto-scaling. 75% of enterprise corporations are already using Kubernetes, with GCP/GCE representing the only solution from the original developers of K8s. As many companies are moving away from monolithic software platforms to microservice driven apps, Istio was presented as a means to extend Kubernetes to a higher level of service in production applications, increasing reliability, based on a collaboration between IBM, Cisco, Google, & Red Hat.
Google Cloud Next 2018 - Day 2 Keynote: "Bringing the Cloud to You"
- Alison Wagonfeld (Head of Marketing for Google Cloud) led the second day Google Cloud Next Keynote, with Garrick Toubassi introducing new upgrades to G Suite and Rajen Sheth lecturing on "customer centered" AI featuring the new 3rd Generation Google TPUs for DL/ML.
- Enterprise partnerships were featured with Miguel Angel Campo-Rembado (Senior VP of Data Science & Analytics at 20th Century Fox) discussing the use of BigQuery AI in media marketing for better predictive recommendations and Laura L. Bandura (Ph.D Research Geophysicist at Chevron) presenting on using AutoML Vision in the oil exploration industry.
- Eyal Manor (VP of Engineering at Google) discussed the new Cloud Services Platform with Kubernetes & Knative, with Kip Compton (SVP at Cisco Cloud Platform & Solutions) speaking on open source multicloud/microservice solutions with Istio.
- Oren Teich presented on serverless solutions with Google Cloud Functions using Docker containers.
- Brad Calder (VP of Cloud Infrastructure) lectured on issues involving security, reliability, & scale in global networks involving 125 different international data centers with Google Cloud, with Prajakta Joshi introducing Cloud Armor as a means to prevent MySQL injection & HTTP flood attacks on web/mobile apps.
- Parag Agrawal (CTO at Twitter) discussed how Twitter uses Google Cloud at petabyte scale to analyze data sets, while Gayathri Rajan (VP of Google Maps Platform) discussed the recent overhaul of Google Maps for better enterprise use in predictive analysis using AI tools like AutoML.
- Ajay Gore (Group CTO at GO-JEK) presented information on how his start-up food delivery service uses Google to serve millions of customers per day in Indonesia.
- Injong Rhee (VP of IoT at Google Cloud) presented on how tech partners are innovating in the device space with edge computing using new advanced data analytics options.
- Shingyoon Hyun (SVP, CTO at LG CNS) spoke on how LG uses Google with IoT devices in manufacturing to detect defects with increased accuracy in inspections.
Google Cloud Next 2018 - Day 3 Keynote: "Made Here Together"
Day Three of the Google Cloud Next conference focused on Cloud Build, a "fully managed continuous integration and continuous delivery (CI/CD) platform" that permits users to "build and test applications in the cloud—at scale." Speakers discussed the available integration of Cloud Build with GitHub (now owned by Microsoft), which makes it easier to add CI/CD processes on top of any GitHub code repository. Learn More About Cloud Build.
Knative provides a set of middleware components that are essential to build modern, source-centric, and container-based applications that can run anywhere: on premises, in the cloud, or even in a third-party data center. Knative components are built on Kubernetes and codify the best practices shared by successful real-world Kubernetes-based frameworks... Knative offers a set of reusable components that focuses on solving many mundane but difficult tasks such as orchestrating source-to-container workflows, routing and managing traffic during deployment, auto-scaling your workloads, or binding running services to eventing ecosystems. Developers can even use familiar idioms, languages, and frameworks to deploy any workload: functions, applications, or containers."
Cloud Services Platform puts all your IT resources into a consistent development, management and control framework, automating away low-value and insecure tasks across your on-premise and Google Cloud infrastructure. Specifically, we’re announcing:
- Service mesh: Availability of Istio 1.0 in open source, Managed Istio, and Apigee API Management for Istio
- Hybrid computing: GKE On-Prem with multi-cluster management
- Policy enforcement: GKE Policy Management, to take control of Kubernetes workloads
- Ops tooling: Stackdriver Service Monitoring
- Serverless computing: GKE Serverless add-on and Knative, an open source serverless framework
- Developer tools: Cloud Build, a fully managed CI/CD platform
Cloud Services Platform is technologically and architecturally aligned with the joint hybrid cloud products we've been developing and bringing to market with our partner, Cisco, with whom we have been collaborating closely. Our joint solution, Cisco Hybrid Cloud Platform for Google Cloud, will be generally available next month and is now certified to be consistent with Kubernetes Engine, enabling GCP out of the box."
gVisor is a user-space kernel, written in Go, that implements a substantial portion of the Linux system surface. It includes an Open Container Initiative (OCI) runtime called runsc that provides an isolation boundary between the application and the host kernel. The runsc runtime integrates with Docker and Kubernetes, making it simple to run sandboxed containers... Containers are not a sandbox. While containers have revolutionized how we develop, package, and deploy applications, running untrusted or potentially malicious code without additional isolation is not a good idea. The efficiency and performance gains from using a single, shared kernel also mean that container escape is possible with a single vulnerability. gVisor is a user-space kernel for containers. It limits the host kernel surface accessible to the application while still giving the application access to all the features it expects. Unlike most kernels, gVisor does not assume or require a fixed set of physical resources; instead, it leverages existing host kernel functionality and runs as a normal user-space process.
Google Cloud & GitHub:
Google Cloud and GitHub are delivering a new integrated experience that connects GitHub with Google’s Cloud Build, our new CI/CD platform. Together, we will provide fast, frictionless, and convenient Continuous Integration (CI) for any repository on GitHub, integrated directly into the GitHub developer workflow. Millions of developers trust GitHub today to store and collaborate around source code. Working with GitHub, we realized we had an opportunity to help make it significantly easier for any repository to add CI, integrate DevOps practices, and improve velocity and productivity. We set out to build that together, and today’s release is the first step in that collaboration.
Advantages of the Google Cloud Services Platform for Developers & Programming Teams
The Google Cloud Services Platform offers important improvements in cross-vendor portability & deployment pipeline management to web/mobile application developers. Istio provides automated failure recovery, load balancing, advanced metrics, and health checking for cloud software applications running in containers on elastic cluster servers in production. Apigee integration includes industry leading API management tools for developers and programmers to utilize in their apps. GCSP's automated infrastructure and managed microservice functions are well suited for the CI/CD demands of Agile teams working for enterprise corporations or independent start-up companies with complex code requirements. With new options for binary & forced signature authorization of container images, GCSP offers better security for web/mobile apps in the cloud. The use of shielded VMS allows for hardened virtual machines to be run with increased web security features. New serverless solutions using Google Cloud Functions or Apache OpenWhisk enable online businesses to move faster to innovate changes instead of building custom web servers with expensive administration costs, while "anywhere support" with containers using Knative avoids vendor lock-in, increasing app portability between hosting companies. Knative works on GCE/GKE (hybrid/multicloud/on-prem), where the combination of Istio & Kubernetes allows for faster innovation of web/mobile applications for businesses. Stackdriver metrics provide a valuable suite of utilities to debug code errors and API connection problems. Google expects the new Cloud Services Platform to be available for devops teams to utilize on their web servers starting during September of 2018.