complexity

A DGA Odyssey: Passive DNS Driven DGA Analysis

A DGA Odyssey: Passive DNS Driven DGA Analysis

January 21, 2020

Domain Generation Algorithm (DGA) techniques have been commonly used by bot-masters to evade detection, which dynamically produce quantities of seemingly random do …
Virtualized service-chained security controls within a layer 2 SDN

Virtualized service-chained security controls within a layer 2 SDN

January 21, 2020

John Studarus and Cynthia Thomas demonstrate how to service-chain traffic through multiple security functions using virtualization and software-defined networking (SDN). John and Cynthia walk you through configuring and modifying layer 2 service chains with open source cloud security tools to monitor and block malicious traffic originating from a network of virtual machines.
Minesweeper and Propane: Two Tools for Improving Network Reliability

Minesweeper and Propane: Two Tools for Improving Network Reliability

January 17, 2020

Over the past 4 decades, networks have become increasingly complex as scalability, quality of service, robustness, and fault-tolerance requirements have grown to m …
Practical, team-focused operability techniques for distributed systems

Practical, team-focused operability techniques for distributed systems

January 17, 2020

Matthew Skelton shares five practical, tried-and-tested techniques for improving operability with many kinds of software systems, including the cloud, serverless, on-premises, and the IoT.
Seeing whats wrong just right

Seeing whats wrong just right

January 16, 2020

A developer hunting for a bug is like a doctor hunting for an illness. She does not need complete understanding of the body for the hunt to be successful. Jasvir Nagra and Marianna Bezler share a few painful distributed web app debugging anecdotes and an alternate approach using virtualization and visualization to get a holistic view of a program to track down elusive bugs.
Architecture without an end state

Architecture without an end state

January 14, 2020

Michael Nygard demonstrates how to design and architect systems that admit changebending and flexing through time. Using a blend of information architecture, technical architecture, and some process change, Michael walks you through examples of rigid systems to show how to transform them into more maneuverable architecture.
Balancing sociotechnical complexity in software architectures

Balancing sociotechnical complexity in software architectures

January 14, 2020

When discussing architecture, things like microservices and the Reactive Manifesto come to mind. However, the culmination and success of technical choices is strongly determined by social context. Evelyn van Kelle and Pepijin van de Kamp explore the interplay of technical issues and the social aspects of working on a team, such as communication and shared understanding of assumptions and choices.
Transparent Huge Pages on Steroids

Transparent Huge Pages on Steroids

January 10, 2020

In big memory machines, hugepages can play a large role in increasing system performance. However, using hugepages manually for different segments of memory adds to application complexity. Linux has a …
Unconventional programming paradigms for the future, now

Unconventional programming paradigms for the future, now

January 6, 2020

As technology advances, our systems are growing more and more complex, reaching the threshold of what we can handle and even comprehend. We need more than tools to keep it under control. We need new ways of thinking. Carin Meier explores new ways to approach systems and tame complexity for the rapidly changing future.
A comprehensive, enterprise-grade, open Hadoop solution from Hewlett Packard Enterprise (sponsored by Hewlett Packard Enterprise)

A comprehensive, enterprise-grade, open Hadoop solution from Hewlett Packard Enterprise (sponsored by Hewlett Packard Enterprise)

January 5, 2020

Bob Patterson offers an overview of Hewlett Packard Enterprise's enterprise-grade Hadoop solution, which has everything you need to accelerate your big data journey: innovative hardware architectures for diverse workloads certified for all leading distros, infrastructure software, services from HPE and partners, and add-ons like object storage.
A practitioners guide to Hadoop security for the hybrid cloud

A practitioners guide to Hadoop security for the hybrid cloud

January 5, 2020

Mark Donsky, Andr Araujo, Syed Rafice, and Manish Ahluwalia walk you through securing a Hadoop cluster. Youll start with a cluster with no security and then add security features related to authentication, authorization, encryption of data at rest, encryption of data in transit, and complete data governance.
Automated Out-Of-Band Management with Ansible and Redfish

Automated Out-Of-Band Management with Ansible and Redfish

January 2, 2020

Ansible is an open source automation engine that automates complex IT tasks. It is a one-to-many agentless mechanism where complex deployment tasks can be controlled and monitored from a central contr …
PNDA: Learn to Bootstrap an Open Source Big Data Platform

PNDA: Learn to Bootstrap an Open Source Big Data Platform

December 28, 2019

Innovation in the big data space is rapid, but combining multiple technologies into an endtoend solution is extremely complex and time consuming. The vision of PNDA, the open source big data analyti …
The five components of a data strategy

The five components of a data strategy

December 28, 2019

While it's clear organizations need to have a comprehensive data strategy, few have actually developed a plan to improve the access, sharing, and usage of data. Evan Levy discusses the five essential components that make up a data strategy and explores the individual attributes of each.
Unraveling data with Spark using deep learning and other algorithms from machine learning

Unraveling data with Spark using deep learning and other algorithms from machine learning

December 28, 2019

Vartika Singh and Jeffrey Shmain walk you through various approaches using the machine learning algorithms available in Spark ML to understand and decipher meaningful patterns in real-world data. Vartika and Jeff also demonstrate how to leverage open source deep learning frameworks to run classification problems on image and text datasets leveraging Spark.
Applying AI to healthcare's biggest opportunity: Clinical variation

Applying AI to healthcare's biggest opportunity: Clinical variation

December 27, 2019

Mercy and Intermountain, two of the largest and most innovative hospital systems in the United States, have recently applied AI to tackle clinical variation within their systems. Todd Steward and Lonny Northrup discuss the application of machine intelligence for optimizing care and provide valuable insights into practice variation for improving clinical pathways.
Deep reinforcement learning in the enterprise: Bridging the gap from games to industry

Deep reinforcement learning in the enterprise: Bridging the gap from games to industry

December 26, 2019

Mark Hammond explores how enterprises can move beyond games and leverage deep reinforcement learning and simulation-based training to build programmable, adaptive, and trusted AI models for their real-world applications.
Let artificial intelligence handle one of the two certainties in this world

Let artificial intelligence handle one of the two certainties in this world

December 25, 2019

Taxes are one of consumers' most complex financial transactions, thanks to a tax code that is 80,000 pages long. Gang Wang explains how Intuit built the industrys only Tax Knowledge Engine, a constraint-based engine that encodes changing financial regulations and provides the foundation for a host of artificial intelligence technologies that save customers time and money.
Model interpretation guidelines for the enterprise: Using Jupyters interactiveness to build better predictive models (sponsored by DataScience.com)

Model interpretation guidelines for the enterprise: Using Jupyters interactiveness to build better predictive models (sponsored by DataScience.com)

December 21, 2019

Pramit Choudhary offers an overview of Datascience.com's model interpretation library Skater, explains how to use it to evaluate models using the Jupyter environment, and shares how it could help analysts, data scientists, and statisticians better understand their model behaviorwithout compromising on the choice of algorithm.
Application tracing tutorial

Application tracing tutorial

December 17, 2019

In the past, applications were monolithic, and tracing flows for performance and bottlenecks was straightforward, as there was likely a single code base. In today's world, with multiple processes constituting a single application, tracing becomes more challenging. Bryan Liles offers a hands-on demonstration for implementing tracing in modern applications.
Tackling the limits of deep learning

Tackling the limits of deep learning

December 17, 2019

AI presents a huge opportunity for businesses to personalize and improve customer experiences and improve efficiency, but the technical complexity of AI puts it out of reach for most companies. Richard Socher explains how Salesforce is doing the heavy lifting to deliver seamless and scalable AI to its customers.
Lightning Talk: Telepresence: Local Development & Debugging of Remote Kubernetes Services

Lightning Talk: Telepresence: Local Development & Debugging of Remote Kubernetes Services

December 15, 2019

Developers who use Kubernetes for multi-container applications face a conundrum: develop locally or on a remote Kubernetes cluster. Local development adds complexity to your development environment, s …
Using Containers for Continuous Integration and Continuous Delivery [I]

Using Containers for Continuous Integration and Continuous Delivery [I]

December 14, 2019

Building and testing is a great use case for containers, both due to the dynamic and isolation aspects, but it increases complexity when scaling to multiple nodes and clusters. Jenkins is an example …
14 ways to bounce a ball: A tour of the web animations ecosystem

14 ways to bounce a ball: A tour of the web animations ecosystem

December 12, 2019

There are more options than ever for animating things on the web. Bryan Braun leads a tour of the web animations ecosystem, comparing animation approaches in detail and exploring the principles that transcend them all. To do this, Bryan uses lessons learned from building and maintaining Bouncy Ball, a project that compares web animation approaches (think, a TodoMVC for web animation).
Access your device hardware with the W3C Generic Sensor API (sponsored by Intel)

Access your device hardware with the W3C Generic Sensor API (sponsored by Intel)

December 11, 2019

Alexis Menard offers an overview of the new W3C Generic Sensor API, which enables you to use hardware sensors in your website or web app. Join in to learn how you can implement it today and catch a glimpse of future plans.
Atomic design as a migration strategy

Atomic design as a migration strategy

December 11, 2019

Atomic design is well suited for migrating web applications. Because you build complexity out of simple components, you can start small and slowly carve out your application. Harrison Harnisch shares how Buffer is migrating six years of development with atomic design.
Delivering quality code frequently (sponsored by Sauce Labs)

Delivering quality code frequently (sponsored by Sauce Labs)

December 9, 2019

Neil Manvar shares best practices for leveraging modern technologies to develop and test maintainable, quality code within CI/CD workflows.
Of monoliths and microservices: Adventures in structuring a web app

Of monoliths and microservices: Adventures in structuring a web app

December 8, 2019

The US Digital Service is building a suite of tools to replace a large legacy application at the Department of Veteran Affairs. Knowing the complexity of the end state and enamored with microservices, the team was much too aggressive in breaking up the product. Shane Russell reflects on this experience, sharing advice and lessons learned on how and when to break up your web app.