database

Offline sync for progressive web apps

Offline sync for progressive web apps

December 14, 2019

Bradley Holt demonstrates how service workers, Apache CouchDB (an open source document database), Hoodie (an open source Node.js backend for offline first apps), and PouchDB (an open source JavaScript database that syncs) can be used to build progressive web apps using an offline-first approach in order to provide fast, zero-latency access to content and data stored directly on the device.
Vitess at HubSpot: How We Moved Hundreds of MySQL Databases into Kubernetes

Vitess at HubSpot: How We Moved Hundreds of MySQL Databases into Kubernetes

December 13, 2019

In early 2017, HubSpot faced a growing problem: our MySQL infrastructure was complex, expensive, and failing to scale. Hundreds of databases running on more than a thousand EC2 instances were managed …
Sharded and Federated Prometheus Servers to Monitor Distributed Databases

Sharded and Federated Prometheus Servers to Monitor Distributed Databases

December 12, 2019

At eBay we have developed a geo-distributed transactional document store called NuData. It is deployed on Kubernetes. The current deployment has thousands of pods across three datacenters, and is moni …
Kubernetes the Database

Kubernetes the Database

December 11, 2019

In the operations world, one of the hardest problems is keeping track of your inventory: Which machines belong to which teams? Which machines are in service? How long have they been there? At New Reli …
Running MySQL on Kubernetes

Running MySQL on Kubernetes

December 11, 2019

MySQL is the world's most popular open source database and there are a number of ways to run it on Kubernetes. This talk will explain and demonstrate how running a complex stateful application such as …
Lightning Talk: TSDB: The Engine behind Prometheus

Lightning Talk: TSDB: The Engine behind Prometheus

December 8, 2019

Prometheus 2.0 release came with a lot of features and improvements and a big contributor to that is TSDB, the new storage engine it came with. TSDB is also a Golang library this means anyone looking …
Using Siamese CNNs for removing duplicate entries from real estate listing databases

Using Siamese CNNs for removing duplicate entries from real estate listing databases

December 4, 2019

Aggregation of geospecific real estate databases results in duplicate entries for properties located near geographical boundaries. Sergey Ermolin and Olga Ermolin detail an approach for identifying duplicate entries via the analysis of images that accompany real estate listings that leverages a transfer learning Siamese architecture based on VGG-16 CNN topology.
Accelerating development velocity of production ML systems with Docker

Accelerating development velocity of production ML systems with Docker

November 30, 2019

Having trouble coordinating development of your production ML system between a team of developers? Microservices drifting and causing problems during debugging? Kinnary Jangla explains how Pinterest dockerized the services powering its home feed and how it impacted the engineering productivity of the company's ML teams while increasing uptime and ease of deployment.
Happy Helming with Service Catalog

Happy Helming with Service Catalog

November 29, 2019

Helm has emerged as a popular tool for distributing and using applications on Kubernetes. The kubernetes/charts repo has almost 150 different packages today! Helm works by bundling Kubernetes resource …
Building career advisory tools for the tech sector using machine learning

Building career advisory tools for the tech sector using machine learning

November 28, 2019

Dice.com recently released several free career advisory tools for technology professionals, including a salary predictor, a tool that recommends the next skills to learn, and a career path explorer. Simon Hughes and Yuri Bykov offer an overview of the machine learning algorithms behind these tools and the technologies used to build, deploy, and monitor these solutions in production.
Code Property Graph: A modern, queryable data storage for source code

Code Property Graph: A modern, queryable data storage for source code

November 28, 2019

Vlad Ionescu and Fabian Yamaguchi outline Code Property Graph (CPG), a unique approach that allows the functional elements of code to be represented in an interconnected graph of data and control flows, which enables semantic information about code to be stored scalably on distributed graph databases over the web while allowing them to be rapidly accessed.
Cuttlefish: Lightweight primitives for online tuning

Cuttlefish: Lightweight primitives for online tuning

November 28, 2019

Tomer Kaftan offers an overview of Cuttlefish, a lightweight framework prototyped in Apache Spark that helps developers adaptively improve the performance of their data processing applications by inserting a few library calls into their code. These calls construct tuning primitives that use reinforcement learning to adaptively modify execution as they observe application performance over time.
Distributed clinical models: Inference without sharing patient data

Distributed clinical models: Inference without sharing patient data

November 26, 2019

Clinical collaboration benefits from pooling data to train models from large datasets, but it's hampered by concerns about sharing data. Balasubramanian Narasimhan, John-Mark Agosta, and Philip Lavori outline a privacy-preserving alternative that creates statistical models equivalent to one from the entire dataset.
Stream processing with Kafka

Stream processing with Kafka

November 20, 2019

Tim Berglund leads a basic architectural introduction to Kafka and walks you through using Kafka Streams and KSQL to process streaming data.
The state of Postgres

The state of Postgres

November 20, 2019

PostgreSQL is often regarded as the worlds most advanced open source databaseand its on fire. Umur Cubukcu moves beyond the typical list of features in the next release to explore why so many new projects just use Postgres as their system of record (or system of engagement) at scale. Along the way, you'll learn how PostgreSQL's extension APIs are fueling innovations in relational databases.
To a hammer, everything is a nail: Choosing the right tool for your business problems (sponsored by Microsoft)

To a hammer, everything is a nail: Choosing the right tool for your business problems (sponsored by Microsoft)

November 20, 2019

The emergence of the cloud combined with open source software ushered in an explosive use of a broad range of technologies. Tobias Ternstrom explains why you should step back and attempt to objectively evaluate the problem you are trying to solve before choosing the tool to fix it.
Vitess and a Kubernetes Operator

Vitess and a Kubernetes Operator

November 15, 2019

Vitess is an open source project started by YouTube to help with scaling of its MySQL databases. It has now gained substantial adoption in the community, especially because it bridges the gap between …
Cryptoeconomics of Enterprise Blockchains

Cryptoeconomics of Enterprise Blockchains

November 14, 2019

Enterprise blockchains are fundamentally redundant, shared-access blockchains with high fault tolerance. Deploying an enterprise blockchain is far more expensive to implement and maintain, but the cos …
Reimagining Identity and Re-Intermediating with Consumers - Through Blockchain

Reimagining Identity and Re-Intermediating with Consumers - Through Blockchain

November 9, 2019

The current model for managing identity is quickly becoming unsustainable costly, disjointed and all too fallible. But thats about to change. SecureKey, along with a consortium of innovative partne …