Presentation Title: Extreme Database Tuning for Big Physics Data in the ATLAS Experiment @ CERN
Speaker: Mr Gancho Dimitrov
Company: CERN
Presentation abstract: This presentation describes a newly-deployed system that accumulates a set of key quantities for a very large number of particle collision events recorded by the ATLAS experiment at the LHC (Large Hadron Collider) at CERN. The main project requirements are the handling of tens of billions of rows per year with minimal DB resources, and providing outstanding performance for the fundamental use cases.

Various challenges were faced in the process of project development, such as large data volume (tested OLTP and basic compressions), large transactions (tens to hundreds of million of rows per transaction) requiring significant amount of undo, row duplication checks, adequate statistics gathering, and SQL execution plan stability.

Currently the system hosts about 25 billion rows and is expected to accommodate future data of 20 billion rows per year. The crucial DB schema design decisions and the Oracle DB features and techniques used will be shared with the audience.

Presentation begins: 07/12/2016 14:10
Presentation duration: 50
Presentation content level: 2 (1 = indepth, 5 = strategic overview)
Audience experience: Intermediate
Audience function: Product Expert, Product User, Systems Architect
Speaker biography:  12+ years experience with Oracle RDBMS. Currently has a liaison role between the CERN IT database services group and the ATLAS database developers community. Main focus is on database schemes design, data management and performance tuning.
Related topics: Database: Management & Administration, Database: Performance & Internals, Database: SQL & PL/SQL
Hall: Hall 10B

ATLAS_DBAs_EIOproject_UKOUG_TECH16_slides.pdf10.5 MB09/12/2016 10:45:13