November 13, 2019

191 words 1 min read

Database optimization for web developers

Database optimization for web developers

Many companies have inadequate database experience because databases like MySQL and PostgreSQL don't require a full-time DBA to administer. Developers now have to have a basic understanding of how to keep their databases happy. Steve Meyers explores how to get the best performance out of your database, covering JOIN order, proper indexing, WHERE filtering, caching, and many other subjects.
Talk Title Database optimization for web developers
Speakers Steve Meyers (Utah Open Source Foundation)
Conference O’Reilly Open Source Convention
Conf Tag
Location Austin, Texas
Date May 16-19, 2016
URL Talk Page
Slides Talk Slides
Video

Many companies have inadequate database experience because databases like MySQL and PostgreSQL don’t require a full-time DBA to administer. Developers now have to have a basic understanding of how to keep their databases happy. Steve Meyers explores how to get the best performance out of your database, covering JOIN order, proper indexing, WHERE filtering, caching, and many other subjects. Steve will load a test database schema and then explore different types of queries and indexes. Note: he will NOT cover in detail things like server options, as changing those are not generally an option for web developers.

sql database postgresql optimization performance
comments powered by Disqus
Scala and the JVM as a big data platform: Lessons from Apache Spark

Scala and the JVM as a big data platform: Lessons from Apache Spark

October 21, 2019

The success of Apache Spark is bringing developers to Scala. For big data, the JVM uses memory inefficiently, causing significant GC challenges. Spark's Project Tungsten fixes these problems with custom data layouts and code generation. Dean Wampler gives an overview of Spark, explaining ongoing improvements and what we should do to improve Scala and the JVM for big data.
Static and dynamic data with Postgres, Kafka, and Bottled Water

Static and dynamic data with Postgres, Kafka, and Bottled Water

November 5, 2019

Chad Bailey demonstrates how to put the combination of static and dynamic data to work in your own apps.
How we built an election report-casting app for the 2015 Nigeria general elections (with little experience building mobile apps, using agile scrum methods for the first time)

How we built an election report-casting app for the 2015 Nigeria general elections (with little experience building mobile apps, using agile scrum methods for the first time)

October 30, 2019

Bulama Yusuf explains how he and his team introduced agile methodologies to build a mobile app with a cloud-based backend at an organization that previously used the waterfall method of software development (and had never built a mobile app before). Bulama outlines the challenges the team faced and the lessons they learned along the way.
Road traffic analysis and agile architectures

Road traffic analysis and agile architectures

October 29, 2019

Kristoffer Dyrkorn outlines an infrastructure that reduces the steep cost of road construction and maintenance. The system provides high-quality and near real-time information by integrating an unusual combination of sensors, devices, protocols, and software. Kristoffer discusses architectural challenges met and choices and mistakes made while trying to keep the architecture receptive to change.
Building DistributedLog, a high-performance replicated log service

Building DistributedLog, a high-performance replicated log service

October 27, 2019

DistributedLog is a high-performance replicated log service built on top of Apache BookKeeper that is the foundation of publish-subscribe at Twitter, serving traffic from transactional databases to real-time data analytic pipelines. Sijie Guo offers an overview of DistributedLog, detailing the technical decisions and challenges behind its creation and how it is used at Twitter.
Faster conclusions using in-memory columnar SQL and machine learning

Faster conclusions using in-memory columnar SQL and machine learning

October 25, 2019

Hadoops traditional batch technologies are quickly being supplanted by in-memory columnar execution to drive faster data-to-value. Wes McKinney and Jacques Nadeau provide an overview of in-memory columnar execution, survey key related technologies, including Kudu, Ibis, Impala, and Drill, and cover a sample use case using Ibis in conjunction with Apache Drill to deliver real-time conclusions.