Aws Re:invent 2017

Many applications are network I/O bound, including common database-based applications and service-based architectures. But operating systems and applications are often not tuned to deliver high performance. This session uncovers hidden issues that lead to low network performance, and shows you how to overcome them to obtain the best network performance possible.

While organizations gain agility and scalability when they migrate to containers and microservices, they also benefit from compliance and security, advantages that are often overlooked. In this session, Kelvin Zhu, lead software engineer at Okta, joins Mitch Beaumont, enterprise solutions architect at AWS, to discuss security best practices for containerized infrastructure. Learn how Okta built their development workflow with an emphasis on security through testing and automation. Dive deep into how containers enable automated security and compliance checks throughout the development lifecycle. Also understand best practices for implementing AWS security and secrets management services for any containerized service architecture.

As your application's infrastructure grows and scales, well-managed container scheduling is critical to ensuring high-availability and resource optimization. In this session, we will deep dive into the challenges and opportunities around container scheduling, as well as the different tools available within Amazon ECS and AWS to carry out efficient container scheduling. We will discuss patterns for container scheduling available with Amazon ECS and the Blox scheduling framework

Learn how Amazon EC2 Spot and Thinkbox Deadline can make your VFX and CG renders explode off the screen, with minimal effort and low cost. This session focuses on rendering workloads combining Deadline (an AWS rendering pipeline management service), Thinkbox Marketplace usage-based licensing for flexible render licensing, and Spot for scalable low-cost computing. Learn how to seamlessly integrate your existing production pipeline, as well as advanced asset management, synchronization, and connections to other AWS services such as AWS storage and networking for advanced workflows, including the extension of on-premises render workflows into the cloud and all-in-cloud rendering pipelines. We also highlight a few real-world examples of customers with actual Hollywood productions.

Scaling a microservice-based infrastructure can be challenging in terms of both technical implementation and developer workflow.  In this talk, AWS Solutions Architect Pierre Steckmeyer will be joined by Will McCutchen, Architect at BuzzFeed, to discuss Amazon ECS as a platform for building a robust infrastructure for microservices. We will look at the key attributes of microservice architectures and how Amazon ECS supports these requirements in production, from configuration to sophisticated workload scheduling to networking capabilities to resource optimization.  We will also examine what it takes to build an end-to-end platform on top of the wider AWS ecosystem, and what it's like to migrate a large engineering organization from a monolithic approach to microservices.

PrivateLink provides private connectivity between VPCs, AWS Services and on-premises applications. Built with the same underlying technology that powers NAT Gateway, Network Load Balancer and AWS Service endpoints, PrivateLink is now available for use with your own applications. In the session, we'll do a deep dive into the underlying network technology that is used by PrivateLink and explore how PrivateLink can be deployed to improve your network topologies and application architectures. We'll also look at how PrivateLink improves micro-service architectures, allowing for services to be vended between AWS accounts and over DirectConnect connections.  

Deep dive into how Amazon ECS can enable secure, natively addressable, and highly performant network interfaces for containers using the recently launched the awsvpc task networking mode. In this session, we focus on how CNI plugins were integrated with the Amazon ECS container agent and discuss the backend changes necessary to enable elastic network interface provisioning for tasks. Shakeel Sorathia, VP of engineering at FOX Digital, discusses best practices for working with Amazon ECS to enable such use cases as network isolation and IP-based routing for service discovery.

If you ask 10 teams why they migrated to containers, you will likely get answers like ‘developer productivity', ‘cost reduction', and ‘faster scaling'. But teams often find there are several other ‘hidden' benefits to using containers for their services. In this talk, Franziska Schmidt, Platform Engineer at Mapbox and Yaniv Donenfeld from AWS will discuss the obvious, and not so obvious benefits of moving to containerized architecture. These include using Docker and ECS to achieve shared libraries for dev teams, separating private infrastructure from shareable code, and making it easier for non-ops engineers to run services.

AWS Cloud adoption is rapidly taking hold within critical aspects of media business processes. New media and other early adopters have been using the cloud for basic transcoding and streaming for several years. But we have seen a significant increase in media workload adoption across more business-critical and complex workloads in content creation, media supply chain management, and content distribution (e.g., broadcast channel playout, publishing, and OTT). This session includes customer panelists from the visual effects, supply chain, and broadcast industries who now see AWS as the new ”normal” for implementing scalable, performant, and cost-effective media workloads. Hear from top leaders in the Media & Entertainment space about their challenges and lessons learned when migrating core media workloads to the cloud.

AWS Fargate makes running containerized workloads on AWS easier than ever before. This session will provide a technical background for using Fargate with your existing containerized services, including best practices for building images, configuring task definitions, task networking, secrets management, and monitoring.

Amazon Virtual Private Cloud (Amazon VPC) enables you to have complete control over your AWS virtual networking environment. Given this control, have you ever wondered how new Amazon VPC features will affect the way you design your AWS networking infrastructure, or even change existing architectures that you use today? In this session, we explore the new design and capabilities and how you might use them.​

As containers become more embedded in the platform tools, debug tools, traces and logs become increasingly important. Nare Hayrapetyan, Senior Software Engineer and Calvin French-Owen, Senior Technical Officer for Segment will discuss the principals of monitoring and debugging containers and the tools Segment has implemented and built for logging, alerting, metric collection, and debugging of containerized services running on Amazon ECS.

If you've ever considered moving part of your application stack to containers, don't miss this session. Amazon ECS Software Engineer Uttara Sridhar will cover best practices for containerizing your code, implementing automated service scaling and monitoring, and setting up automated CI/CD pipelines with fail-safe deployments. Manjeeva Silva and Thilina Gunasinghe will show how McDonalds implemented their home delivery platform in four months using Docker containers and Amazon ECS to serve tens of thousands of customers.

Pharmaceutical company processes tend to be slow when dealing with customer-facing applications that contain FDA-validated messages, all while maintaining infrastructure and security standards.  In this session, discover how Mylan, a US–based global generic and specialty pharmaceutical company, overcame these obstacles and provided scalable solutions by leveraging AWS DevOps methods that lower time to market, while maintaining robust security and release management practices.  During the presentation, learn how Mylan redefined process models such as infrastructure change management to define new security and process models.  Additionally, learn how Mylan used services like Amazon S3, Elastic Load Balancing (ELB), and AWS CloudFormation to define these new models.

Image recognition is a field of deep learning that uses neural networks to recognize the subject and traits for a given image. In Japan, Cookpad uses Amazon ECS to run an image recognition platform on clusters of GPU-enabled EC2 instances. In this session, hear from Cookpad about the challenges they faced building and scaling this advanced, user-friendly service to ensure high-availability and low-latency for tens of millions of users.

In this session, we explore the new Network Load Balancer that was launched as part of the Elastic Load Balancing service, which can load balance any kind of TCP traffic. This offers customers a high-performance, scalable, low-cost load balancer that can handle millions of requests per second with very low latencies, while maintaining high levels of performance. Come and learn more about this new Network Load Balancer.

A lot of progress has been made on how to bootstrap a cluster since Kubernetes' first commit and is now only a matter of minutes to go from zero to a running cluster on Amazon Web Services. However, evolving a simple Kubernetes architecture to be ready for production in a large enterprise can quickly become overwhelming with options for configuration and customization.    In this session, Arun Gupta, Open Source Strategist for AWS and Raffaele Di Fazio, software engineer at leading European fashion platform Zalando, will show common practices for running Kubernetes on AWS and share insights from experience in operating tens of Kubernetes clusters in production on AWS. We will cover options and recommendations on how to install and manage clusters, configure high availability, perform rolling upgrades and handle disaster recovery, as well as continuous integration and deployment of applications, logging, and security.

Sick of getting paged at 2am and wondering "where did all my disk space go?" New Docker users often start with a stock image in order to get up and running quickly, but this can cause problems as your application matures and scales. Creating efficient container images is important to maximize resources, and deliver critical security benefits.  In this session, AWS Sr. Technical Evangelist Abby Fuller will cover how to create effective images to run containers in production. This includes an in-depth discussion of how Docker image layers work, things you should think about when creating your images, working with Amazon EC2 Container Registry, and mise-en-place for install dependencies.   Prakash Janakiraman, Co-Founder and Chief Architect at Nextdoor will discuss high-level and language specific best practices for with building images and how Nextdoor uses these practices to successfully scale their containerized services with a small team.

The Clinical Innovation Labs team at Eli Lilly and Company is leveraging AWS services, design thinking methodology, and co-creation to transform ideas for translating clinical research into real-world solutions. The Eli Lilly "Innovators' Platform" is a rapid prototyping environment that combines patient behavior discovery analysis, art-of-the-possible storyboarding, health device mockup creation, and simulated patient walkthrough analysis. This platform is used to demonstrate the capabilities of emerging technologies and enables participants to contribute ideas to extend the platform. This presentation describes how the team and its processes work together, what components make up the platform, and why it's making an impact on patient health. We discuss the team's use of various AWS services, including AWS Lambda, Amazon API Gateway, AWS IoT, Amazon Cognito, Amazon S3, and AWS Elastic Beanstalk. We also provide demos of what has been built using this platform methodology.

Batch processing is useful to analyze large amounts of data. But configuring and scaling a cluster of virtual machines to process complex batch jobs can be difficult. In this talk, we'll show how to use containers on AWS for batch processing jobs that can scale quickly and cost-effectively. We will also discuss AWS Batch, our fully managed batch-processing service. You'll also hear from GoPro and Here about how they use AWS to run batch processing jobs at scale including best practices for ensuring efficient scheduling, fine-grained monitoring, compute resource automatic scaling, and security for your batch jobs.