aws

From puzzles to products

From puzzles to products

January 21, 2020

Jess Kerr argues that most programming careers aren't about writing software; they're about changing it. With this distinction, she'll share some things about reuse, delivery, quality, and how to grow as a programmer.
Lightning Talk: Identify Potential Cost Savings on Public Cloud

Lightning Talk: Identify Potential Cost Savings on Public Cloud

January 20, 2020

With an amount of 10 billion dollars being wasted on top 3 big players of public cloud (AWS, GCP and Azure). Cloud Cost Optimization is a real issue. That's why we have released Komiser, free and open …
Untrusted? No problem: A story on the latest Kubernetes container sandbox mechanisms

Untrusted? No problem: A story on the latest Kubernetes container sandbox mechanisms

January 18, 2020

The last two years have seen the emergence of several mechanisms to isolate workloads in containers as well as Kubernetes's ability to run these in a single multitenant cluster. Ricardo Aravena explores the pros and cons and explains how users can benefit from them.
Building resilient serverless systems

Building resilient serverless systems

January 17, 2020

John Chapin explains howin this brave new world of managed services and platformsyou can use serverless technologies and an infrastructure-as-code mind-set to architect, build, and operate resilient systems that survive even massive vendor outages.
How a scientist would improve serverless functions

How a scientist would improve serverless functions

January 16, 2020

How can you reliably improve and refactor serverless applications? How do you ensure you have covered all the unexpected edge cases that occur in production? Gero Vermaas and Jochem Schulenklopper explain and demonstrate a scientific approach (promoted by GitHub in its Scientist library) that enables you to release refactored serverless applications to production with great confidence.
When two-pizza teams plan a banquet: Lightweight architecture governance

When two-pizza teams plan a banquet: Lightweight architecture governance

January 15, 2020

There are two common architectural failure modes: hierarchical command and control from ivory-tower architects with strict approvals and rigorous control gates, and chaos with every team doing what they want with little governance. Jonny LeRoy explores the Goldilocks zone that ensures that teams handle organizational risks and opportunities while giving themselves as much autonomy as possible.
Build your own data lake with AWS Glue and Amazon Athena (sponsored by Amazon Web Services)

Build your own data lake with AWS Glue and Amazon Athena (sponsored by Amazon Web Services)

January 14, 2020

Damon Cortesi demonstrates how to use AWS Glue and Amazon Athena to implement an end-to-end pipeline.
Building a serverless big data application on AWS

Building a serverless big data application on AWS

January 14, 2020

Serverless technologies let you build and scale applications and services rapidly without the need to provision or manage servers. Join in to learn how to incorporate serverless concepts into your big data architectures. You'll explore design patterns to ingest, store, and analyze your data as you build a big data application using AWS technologies such as S3, Athena, Kinesis, and more.
Executive Briefing: AWS technology trendsData lakes and analytics

Executive Briefing: AWS technology trendsData lakes and analytics

January 12, 2020

Nikki Rouda shares key trends in data lakes and analytics and explains how they shape the services offered by AWS. Specific topics include the rise of machine-generated data and semistructured and unstructured data as dominant sources of new data, the move toward serverless, SPI-centric computing, and the growing need for local access to data from users around the world.
Developing and Deploying Microservices with Toro Unikernel

Developing and Deploying Microservices with Toro Unikernel

January 8, 2020

In a cloud-based architecture, microservices are deployed on VMs which are guests that run a General Purpose OS and the microservice runs as a user application. In this context, Toro is a dedicated un …
Introduction to AWX

Introduction to AWX

January 8, 2020

If you started to work with AWX GUI, You might have questions like: What is AWX? How do I use AWX to manage my environment? Can I use RBAC in AWX? Can I use Authentication methods like SAML, Github wi …
Utilising OSS to Operate a Centralised, Globally Distributed Cloud Platform

Utilising OSS to Operate a Centralised, Globally Distributed Cloud Platform

January 8, 2020

Cond Nast International is home to some of the largest online publications in the world - including Vogue, GQ, Wired, and Vanity Fair. In an effort to provide a cohesive vision for these brands acros …
Transforming a financial services data infrastructure for the modern era by building a PCI DSS-compliant data platform from the ground up on AWS

Transforming a financial services data infrastructure for the modern era by building a PCI DSS-compliant data platform from the ground up on AWS

January 4, 2020

Eoin O'Flanagan and Darragh McConville explain how NewDay built a high-performance contemporary data processing platform from the ground up on AWS. Join in to explore the company's journey from a traditional legacy onsite data estate to an entirely cloud-based PCI DSS-compliant platform.
Cost-effective Presto on AWS with Spot nodes

Cost-effective Presto on AWS with Spot nodes

December 26, 2019

Did you know you can run Presto in AWS at a tenth of the cost with AWS Spot nodes, with just a few architectural enhancements to Presto. Shubham Tagra explores the gaps in Presto architecture, explains how to use Spot nodes, covers enhancements, and showcases the improvements in terms of reliability and TCO achieved through them.
Database migrations don't have to be painful, but the road will be bumpy

Database migrations don't have to be painful, but the road will be bumpy

December 25, 2019

Adrian Lungu and Serban Teodorescu explain howinspired by the green-blue deployment techniquethe Adobe Audience Manager team developed an active-passive database migration procedure that allows them to test database clusters in production, minimizing the risks without compromising the innovation.
Live Aggregators: A scalable, cost-effective, and reliable way of aggregating billions of messages in real time

Live Aggregators: A scalable, cost-effective, and reliable way of aggregating billions of messages in real time

December 23, 2019

Osman Sarood and Chunky Gupta discuss Mists real-time data pipeline, focusing on Live Aggregators (LA)a highly reliable and scalable in-house real-time aggregation system that can autoscale for sudden changes in load. LA is 80% cheaper than competing streaming solutions due to running over AWS Spot Instances and having 70% CPU utilization.
Low Latency Multi-cluster Kubernetes Networking in AWS

Low Latency Multi-cluster Kubernetes Networking in AWS

December 21, 2019

Lyft is migrating their entire service stack of hundreds of microservices to Kubernetes on AWS. A critical component to Lyfts successful migration is their open source set of CNI plugins which implem …
Scaling visualization for big data and analytics in the cloud

Scaling visualization for big data and analytics in the cloud

December 21, 2019

Jaipaul Agonus and Daniel Monteiro do Carmo Rosa detail big data analytics and visualization practices and tools used by FINRA to support machine learning and other surveillance activities that the Market Regulation Department conducts in the AWS cloud.
Serverless workflows for orchestration hybrid cluster-based and serverless processing

Serverless workflows for orchestration hybrid cluster-based and serverless processing

December 21, 2019

Serverless implementation of core processing is quickly becoming a production-ready solution. However, companies with existing processing pipelines may find it hard to go completely serverless. Serverless workflows unite the serverless and cluster worlds, with the benefits of both approaches. Rustem Feyzkhanov demonstrates how serverless workflows change your perception of software architecture.
(Continuous) threat modeling: What works?

(Continuous) threat modeling: What works?

December 19, 2019

Threat modeling as a discipline has always enjoyed a special place in development, going from "Why do it?" to "I should do it one of these days" to "We did it and didn't even get a T-shirt." Many competing methodologies, interests, and constraints help make the process more difficult than it needs to be, reducing the results. Izar Tarandach shares the approach Autodesk uses for threat modeling.
What the reproducibility problem means for your business

What the reproducibility problem means for your business

December 19, 2019

Academic research has been plagued by a reproducibility crisis in fields ranging from medicine to psychology. Stuart Buck explains how to take precautions in your data analysis and experiments so as to avoid those reproducibility problems.
Content systems architecture: Approaches in a decoupled world

Content systems architecture: Approaches in a decoupled world

December 18, 2019

Modern content "management" systems are as conceptually challenging as they are technically difficult. Architecting them isnt (strictly) AWS configuring or software solutioning now. The work requires an evolution from strategic planning to collaborative strategic thinking. Diana Montalion explores "archistructure": enabling everyone to engage with the parts through the lens of the whole.
From Issue to PR Merged: A Fluentd Tail

From Issue to PR Merged: A Fluentd Tail

December 16, 2019

Do you often find yourself opening an issue or looking for an alternative open-source project with support for your use case? Not sure where to start in contributing a fix for an issue?Getting involve …
Living with the Pathology of the Cloud: How AWS Runs Lots of Clusters

Living with the Pathology of the Cloud: How AWS Runs Lots of Clusters

December 16, 2019

Disk speed screeches to a crawl, packets get dropped, connections time out: welcome to the cloud! Most of the time the cloud "just works", but when it doesnt, how does Kubernetes and etcd handle fail …
Serverless cloud showdown: Orchestrating functions

Serverless cloud showdown: Orchestrating functions

December 15, 2019

As fans of serverless and event-driven architectures, Kenny Baas-Schwegler and Marc Duiker wanted to see how easy it was to create a serverless application in AWS, Azure, and Google Cloudspecifically, by comparing how easy it is to orchestrate functions, using a current car park management example solution. Join them to learn the pros and cons of each cloud vendor.
Serverless content delivery (a.k.a. Livin' on the edge)

Serverless content delivery (a.k.a. Livin' on the edge)

December 15, 2019

The lines between static and dynamic content are blurred, and its more difficult than ever to choose the right technologies for your requirements and budget. John Chapin takes you on a step-by-step journey from hosting static content on AWS S3 to deploying dynamic, complex business logic mere milliseconds away from your users with AWS CloudFront, Lambda@Edge, and more.
The architect's blind spot: How to align architecture and organizational structure to better your products, processes, and people

The architect's blind spot: How to align architecture and organizational structure to better your products, processes, and people

December 15, 2019

Great architectures are not just about software but also about the people that create it. Traces of how people collaborate during the creation of software systems are captured in data sources like version control history, source code, and ticketing systems. Luc Brandts and Pepijn van de Kamp explain how analyzing this data provides valuable insights and input for your architectural strategy.
Airbnb Service Discovery: Past, Present, Future (Challenges of Change)

Airbnb Service Discovery: Past, Present, Future (Challenges of Change)

December 13, 2019

In 2013, Airbnb released an open source service discovery solution (SmartStack) and has functioned on the same framework for years. Historically our infrastructure ran on AWS EC2 instances and utilize …