A Call Detail Record (CDR) is a data record produced by telecommunication equipment consisting of detail of call transaction logs. It contains valuable information for many purposes of several domains such as billing,...
详细信息
A Call Detail Record (CDR) is a data record produced by telecommunication equipment consisting of detail of call transaction logs. It contains valuable information for many purposes of several domains such as billing, fraud detection and analytical purposes. However, in the real world, these needs face a big data challenge. Billions CDRs are generated every day and the processing systems are expected to deliver results in a timely manner. In our case, the system also has constraint that is running in limited computation resources. We found that our current production system was not enough to meet these needs. We had successfully analyzed the current system bottleneck and found the root cause. Based on this analysis, we designed and implemented a better performance system which is based on MapReduce and running on Hadoop cluster. this paper presents the analysis of previous system and the design and implementation of new system, called MS2. In this paper, we also provide empirical evidence demonstrating the efficiency and linearity of MS2. In a test case of telecommunication mediation system, our test has shown that MS2 reduces overhead by 44% and speedup performance by nearly twice compared to previous system. From benchmarking with several related technologies in large scale data processing, MS2 is also shown to perform better in case of CDR batch processing. Running on a cluster consists of eight core CPU and two conventional disks, MS2 is able to process 67,000 CDRs/second.
Microgrid is one of the promising solutions to achieving sustainable and efficiently operating power systems. With increasing number of distributed generators, dispersed storage systems and advancing load control capa...
详细信息
ISBN:
(纸本)9781467379120
Microgrid is one of the promising solutions to achieving sustainable and efficiently operating power systems. With increasing number of distributed generators, dispersed storage systems and advancing load control capabilities, microgrids are going to play an important role in the future smart grid structure. the recent focus in this area of study is on using the field data gathered from pilot applications to develop virtual test beds to be used during replication, testing of various cases and estimating long term outcomes of microgrids with different specifications. this paper describes development of a virtual test bed focused on analyzing microgrid and utility power flow relations using the field data and energy management logic of a microgrid laboratory. In addition to modeling a flexible structure that can be scaled and modified according to research interests, a KNX controlled dimmer is also simulated for analyzing the integration of an existing home automation technology into microgrid control actions.
parallel disk systems are capable of fulfilling rapidly increasing demands on both large storage capacity and high I/O performance. However, it is challenging to significantly increase disk I/O bandwidth for data-inte...
详细信息
parallel disk systems are capable of fulfilling rapidly increasing demands on both large storage capacity and high I/O performance. However, it is challenging to significantly increase disk I/O bandwidth for data-intensive workloads due to (1) reliability and instant processing of data requests under dynamic workload conditions, and (2) the optimum tradeoff between system scalability and data reliability in data-intensive systems. To increase computing performance and reduce power consumption, Graphics Processing Units (GPUs) will be used. As the architectures and data processing algorithms for GPU-based parallel disk systems are still in their infancy, this research will develop novel hardware and software architectures that include parallel GPU, flash disks, and disk arrays for data-intensive applications. (c) 2014 Published by Elsevier B.V.
Two camps of file systems exist: parallel file systems designed for conventional high performance computing (HPC) and distributed file systems designed for newly emerged data-intensive applications. Addressing the big...
详细信息
ISBN:
(纸本)9781479955480
Two camps of file systems exist: parallel file systems designed for conventional high performance computing (HPC) and distributed file systems designed for newly emerged data-intensive applications. Addressing the big data challenge requires an approach that utilizes both high performance computing and data-intensive computing power. thus, HPC applications may need to interact withdistributed file systems, such as HDFS. the N-1 (N-to-1) parallel file write is a critical technical challenge, because it is very common for HPC applications but HDFS does not allow it. this study introduces a system solution, named SCALER, which allows MPI based applications to directly access HDFS without extra data movement. SCALER supports N-1 file write at boththe inter-block level and intra-block level. Experimental results confirm that SCALER achieves the design goal efficiently.
Denial of Service attack (DoS) forms a permanent risk to the traditional networks and the cloud environment. this malicious attack can be amplified by distributed Denial of Service (DDoS) attacks. Moreover, the cloud ...
详细信息
ISBN:
(纸本)9781479986613
Denial of Service attack (DoS) forms a permanent risk to the traditional networks and the cloud environment. this malicious attack can be amplified by distributed Denial of Service (DDoS) attacks. Moreover, the cloud payment model can be affected by such attacks exploiting the cloud scalability. In this case, it is called Economical Denial of Sustainability (EDoS) attack. this study introduces an effective solution that is designed to counteract such attacks and protect targeted networks. the proposed framework is called Enhanced DDoS-Mitigation System (Enhanced DDoS-MS). this method is tested practically and the test's results proved the success of the framework in limiting the end-to-end response time and handling complex versions of these attacks on multiple layers.
the proceedings contain 130 papers. the topics discussed include: an energy driven architecture for wireless sensor networks;a component based hybrid embedded framework for mobile robot;lightweight dynamic partitionin...
ISBN:
(纸本)9780769548791
the proceedings contain 130 papers. the topics discussed include: an energy driven architecture for wireless sensor networks;a component based hybrid embedded framework for mobile robot;lightweight dynamic partitioning for last level cache of multicore processor on real system;a virtual sample generation approach for speculative multithreading using feature sets and abstract syntax trees;layered models for general parallel computation based on heterogeneous system;can we make it faster? efficient may-happen-in-parallel analysis revisited;solving parameter selection problem of helper thread prefetching via real-time hardware performance monitoring;a non-blocking self-organizing linked list algorithm;a smart-card-based remote user authentication protocol with privacy support;length-constrained and connected tours for sensor networks;and an efficient mobile social network for enhancing contents sharing over mobile ad-hoc networks.
Embedded image processing systems have many challenges, due to large computational requirements and other physical, power, and environmental constraints. However recent contemporary mobile devices include a graphical ...
详细信息
ISBN:
(纸本)9789897581335
Embedded image processing systems have many challenges, due to large computational requirements and other physical, power, and environmental constraints. However recent contemporary mobile devices include a graphical processing unit (GPU) in order to offer better use interface in terms of graphics. Some of these embedded GPUs also support OpenCL which allows the use of computation capacity of embedded GPUs for general purpose computing. Within this OpenCL support, challenges of image processing in embedded systems become easier to handle. In this paper, we present a new OpenCL-based image processing library, named TRABZ-10, which is specifically designed to run on an embedded platform. Our results show that the functions of TRABZ-10 show 7X speedup on embedded platform over the functions of OpenCV on average.
Today, software architecture has a vital role in achieving quality goals for large scale distributed software systems which is made up of components and connectors. Especially, software development mainly consists of ...
详细信息
Today, software architecture has a vital role in achieving quality goals for large scale distributed software systems which is made up of components and connectors. Especially, software development mainly consists of composing re-usable components. the main issue in this approach resides in the difficulty to make these heterogeneous components communicate with each other smoothly, especially in mobile and pervasive computing area. these components can be replaced, dropped or added easily using injection of control mechanism (IoC). In this work, we propose and validate a universal connector framework that allows, through a web service interface using cloud technologies, diverse software components and mobile devices communicate with each other. For example, components and devices in pervasive systems can exchange context information, and analyze them to deduce new rules. As a proof of concept, we apply this connector in a mobile messenger context and shows our results. (C) 2014 Elsevier B.V.
Internet of things (IoT) is a fast-growing innovation that will greatly change the way humans live. It can be thought of as the next big step in Internet technology. What really enable IoT to be a possibility are the ...
详细信息
ISBN:
(纸本)9781479946181
Internet of things (IoT) is a fast-growing innovation that will greatly change the way humans live. It can be thought of as the next big step in Internet technology. What really enable IoT to be a possibility are the various technologiesthat build it up. the IoT architecture mainly requires two types of technologies: data acquisition technologies and networking technologies. Many technologies are currently present that aim to serve as components to the IoT paradigm. this paper aims to categorize the various technologies present that are commonly used by Internet of things.
In a parallel processing system, a pancake graph is one of the superior topologies for interconnection network because of the small diameter and the high degree. In previous research, fault-tolerant routing using rest...
详细信息
ISBN:
(纸本)9781479983346
In a parallel processing system, a pancake graph is one of the superior topologies for interconnection network because of the small diameter and the high degree. In previous research, fault-tolerant routing using restricted global information called safety levels in a pancake graph was proposed. But there are some rooms for improvement. therefore, we propose a fault-tolerant routing algorithm based on improved safety levels to attain higher reachability. In addition, we estimated the proposed method in time and space complexities, and carried out a computer experiment to verify its effectiveness.
暂无评论