CTO of SV Group to Present at Big Data Conference – Strata in New York
At the end of September, a representative of our company, CTO Petar Zecevic, presented at the Strata Data Conference in New York, which took place from 23 to 26 September 2019. Although he is a regular speaker at Big Data conferences around the World, Strata is one that is globally recognized as “the” Big Data conference in the world.
In collaboration with the Washington University DiRAC Institute, Petar participated in one of the largest big data projects in the world - The Large Scale Survey Telescope (LSST). They created an AXS (Astronomy eXtensions for Spark) system that resides on Apache Spark and can be used to analyze data from LSST. The LSST project mission is to answer some fundamental questions about the origin and nature of the universe by analyzing vast amounts of astronomical data. Following the project, the presentation covered Spark's use in analyzing astronomical data on the LSST scale.
As our colleague explained in the presentation, the unique design of LSST telescope makes it possible to cover large areas of the sky and obtain images of the finest objects. After 10 years of research work, it will produce about 80 PB of data in images and catalog data. The presentation also explains why AXS is so fast at processing and merging data from multiple astronomical catalogs. A broader description of the presentation can be found on the Strata Conference website.
In addition to being the author of the book about Apache Spark (Manning 2016), Petar regularly gives Apache Spark training workshops for our users. In addition to Zagreb, the workshops took place in Spain - Madrid and Barcelona. The 'Spark Empowerment Workshop' is part of the SV Group's ongoing training offer. The workshop is adaptable for beginners, as well as more advanced users. Likewise, its duration can be adjusted to clients’ needs. It can take several hours, a whole day or few days. If you have any questions, feel free to reach out!