Navigating in stormy waters: An approach to traffic management with Istio
March 1, 2020
History repeats itself. Some years ago, software engineers started to implement frameworks to ease the development of software applications. Laurentiu Spilca walks you through how microservices are currently delivered and what Istio can do for you in regard to traffic management.
Architecting a data analytics service both in the public cloud and in the on-premise private cloud: ETL, BI, and machine learning (sponsored by SK Holdings)
February 16, 2020
Jungwook Seo walks you through a data analytics platform in the cloud by the name of AccuInsight+ with eight data analytic services in the CloudZ (one of the biggest cloud service providers in Korea), which SK Holdings announced in January 2019.
Orchestrating data workflows using a fully serverless architecture
February 11, 2020
Use of data workflows is a fundamental functionality of any data engineering team. Nonetheless, designing an easy-to-use, scalable, and flexible data workflow platform is a complex undertaking. Tomer Levi walks you through how the data engineering team at Fundbox uses AWS serverless technologies to address this problem and how it enables data scientists, BI devs, and engineers move faster.
Running AI workloads in containers (sponsored by BMC Software)
February 10, 2020
Developing, deploying and managing AI and anomaly detection models is tough business. See-Kit Lam details how Malwarebytes has leveraged containerization, scheduling, and orchestration to build a behavioral detection platform and a pipeline to bring models from concept to production.
Spark on Kubernetes for data science
February 10, 2020
Spark on Kubernetes is a winning combination for data science that stitches together a flexible platform harnessing the best of both worlds. Jordan Volz gives a brief overview of Spark and Kubernetes, the Spark on Kubernetes project, why its an ideal fit for data scientists who may have been dissatisfied with other iterations of Spark in the past, and some applications.
Integrating security into modern software development: A workflow study
January 28, 2020
Application security testing has been around for a long time, yet successful attacks continue despite significant investments in application security. Shift left isnt enough for modern software development that needs integrated and automated continuous security testing. Lucas Charles looks at three key considerations to get you there.
Kubernetes day 3: The state of Kubernetes development tooling
January 28, 2020
Developers working with Kubernetes still wonder what the optimal development workflow looks like. Ellen Korbes explores the capabilities of the tooling available in the current landscape and sees if it can offer end-to-end workflows that perform effectively in the real world.
Large-scale automated storage on Kubernetes
January 28, 2020
Managing large stateful applications is tough. Matt Schallert outlines the challenges of automating stateful systems at scale and details how embracing a declarative approach can ease operation and automation of these systems on orchestrators such as Kubernetes. He then demonstrates how to apply this methodology to different types of stateful workloads.
Kubernetes for the Impatient
January 20, 2020
Everyone keeps telling you that containers need orchestration, but you're not so sure; maybe they could go for some light jazz? Or maybe serverless is here to save us from the tyranny of (virtual) machines, but meanwhile somebody's gotta kuber some netes, and it's likely to be you.
Big data analytics in the public cloud: Challenges and opportunities
January 14, 2020
Jian Zhang, Chendi Xue, and Yuan Zhou explore the challenges of migrating big data analytics workloads to the public cloud (e.g., performance lost and missing features) and demonstrate how to use a new in-memory data accelerator leveraging persistent memory and RDMA NICs to resolve this issues and enable new opportunities for big data workloads on the cloud.
Migrating Apache Oozie workflows to Apache Airflow
January 8, 2020
Apache Oozie and Apache Airflow (incubating) are both widely used workflow orchestration systems, the former focusing on Apache Hadoop jobs. Feng Lu, James Malone, Apurva Desai, and Cameron Moberg explore an open source Oozie-to-Airflow migration tool developed at Google as a part of creating an effective cross-cloud and cross-system solution.
Approaches for Plumbing Hardware Accelerated Interfaces to Containerized Network Functions
January 6, 2020
There is strong interest in containerizing network functions to leverage the obvious advantages of containerization. Many network functions require user space access to layer 3 or layer 2 high speed i …
Transforming a financial services data infrastructure for the modern era by building a PCI DSS-compliant data platform from the ground up on AWS
January 4, 2020
Eoin O'Flanagan and Darragh McConville explain how NewDay built a high-performance contemporary data processing platform from the ground up on AWS. Join in to explore the company's journey from a traditional legacy onsite data estate to an entirely cloud-based PCI DSS-compliant platform.