We introduce SparkCL, an open source unified programming framework based on Java, OpenCL and the Apache Spark framework. The motivation behind this work is to bring unconventional compute cores such as FPGAs/GPUs/APUs/DSPs and future core types into mainstream programming use. The framework allows equal treatment of different computing devices under the Spark framework and introduces the abilit...

Apache Spark is a popular framework for data analytics with attractive features such as fault tolerance and interoperability with the Hadoop ecosystem. Unfortunately, many analytics operations in Spark are an order of magnitude or more slower compared to native implementations written with high performance computing tools such as MPI. There is a need to bridge the performance gap while retainin...

The densification process and grain analysis of consolidated NiAl-CNT composites at 1000 °C, varied heating rates from 50 °C/min to 150 was investigated. results revealed the effect rate on behaviour samples. displacement decreased 3.39 mm 2.63 with increasing rate, while porosity increased by 69% rapid rate. sintered samples through electron backscattered (EBSD) technique indicates evolution b...

Spark is gaining wide industry adoption due to its superior performance, simple interfaces, and a rich library for analysis and calculation. Like many projects in the big data ecosystem, Spark runs on the Java Virtual Machine (JVM). Because Spark can store large amounts of data in memory, it has a major reliance on Java’s memory management and garbage collection (GC). New initiatives like Proje...

MapReduce and Spark are two very popular open source cluster computing frameworks for large scale data analytics. These frameworks hide the complexity of task parallelism and fault-tolerance, by exposing a simple programming API to users. In this paper, we evaluate the major architectural components in MapReduce and Spark frameworks including: shuffle, execution model, and caching, by using a s...

.........................................................................................................................3 INTRODUCTION ................................................................................................................5 DIESEL ENGINE TECHNOLOGY AND EMISSION REGULATIONS .............................7 PHYSICAL AND CHEMICAL NATURE OF DIESEL AEROSOL ......................

The spark energy transferred under the highly stratified conditions during late injection in a spray-guided spark-ignition direct-injection (SG-SIDI) engine is not well characterized. The impact of high pressures, temperatures, velocities, and variations in local fuel concentration along with temporal and/or spatial variations on spark performance must be better characterized. Previous spark ig...

During the 2015-2016 academic year, I conducted research about Spark, BlinkDB and various sampling techniques. This research helped the team have a better understanding of the capabilities and properties of Spark, BlinkDB system and different sampling technologies. Additionally, I benchmarked and implemented various Machine learning and sampling methods on the top of both Spark and BlinkDB. The...

Apache Spark has become a key platform for Big Data Analytics, yet it lacks complete support for debugging analytics programs. As a result, the development of a new analytical toolkit can be a painstakingly long process [7, 2, 4]. To fill this gap, we are developing Spark-BDD (Big Data Debugger), which brings a traditional interactive debugger experience to the Spark platform. Analytic programm...