Big Data is a term defining data that has three main characteristics. First, it involves a great volume of data. Second, the data cannot be structured into regular database tables and third, the data is produced with ...
详细信息
ISBN:
(纸本)9781467361149
Big Data is a term defining data that has three main characteristics. First, it involves a great volume of data. Second, the data cannot be structured into regular database tables and third, the data is produced with great velocity and must be captured and processed rapidly. Oracle adds a fourth characteristic for this kind of data and that is low value density, meaning that sometimes there is a very big volume of data to process before finding valuable needed information. Big Data is a relatively new term that came from the need of big companies like Yahoo, Google, Facebook to analyze big amounts of unstructured data, but this need could be identified in a number of other big enterprises as well in the research and development field. the framework for processing Big Data consists of a number of software tools that will be presented in the paper, and briefly listed here. there is Hadoop, an open source platform that consists of the Hadoop kernel, Hadoop distributed File System (HDFS), MapReduce and several related instruments. Two of the main problems that occur when studying Big Data are the storage capacity and the processing power. that is the area where using Grid Technologies can provide help. Grid computing refers to a special kind of distributedcomputing. A Grid computing system must contain a computing Element (CE), and a number of Storage Elements (SE) and Worker Nodes (WN). the CE provides the connection with other GRID networks and uses a Workload Management System to dispatch jobs on the Worker Nodes. the Storage Element is in charge withthe storage of the input and the output of the data needed for the job execution. the main purpose of this article is to present a way of processing Big Data using Grid Technologies. For that, the framework for managing Big Data will be presented along withthe way to implement it around a grid architecture.
Developing cross-organizational business processes is a tedious task. the partners have to agree on a common data format and meaning as well as on the Quality of Service (QoS) requirements each partner has to fulfill....
详细信息
ISBN:
(纸本)9780769528915
Developing cross-organizational business processes is a tedious task. the partners have to agree on a common data format and meaning as well as on the Quality of Service (QoS) requirements each partner has to fulfill. the QoS requirements are typically described using Service Level Agreements (SLAs) among the partners. In this paper we propose a top-down modeling approach for Web service based business processes to capture the functional and non-functional aspects using a choreography language (WS-CDL) which describes the message interactions among the participants. the choreography is annotated with SLAs for the different partners. For each partner in the process, an orchestration (in WS-BPEL) and the necessary Web service templates are automatically generated. Additionally, the Service Level Objectives (SLOs) from the partner SLAs are automatically translated into policies which can then be enforced by a BPEL engine during execution.
For some of the Internet-of-things (IoT) applications, there is a need for processing huge amounts of data stemming from the network edge in near real-time manner. To this end several in-network computation frameworks...
详细信息
ISBN:
(纸本)9781450385664
For some of the Internet-of-things (IoT) applications, there is a need for processing huge amounts of data stemming from the network edge in near real-time manner. To this end several in-network computation frameworks have been developed which deploy functions in the computing infrastructure from the edge to the cloud. Some of these frameworks take a centralized approach to the orchestration problem with a central entity making deployment decisions of the functions. Others decentralize such decisions. In this paper, we present HYdrO, which is a hybrid approach to orchestration of functions, i.e., a centralized instance gathers the state of the network and provides hints to the individual computing nodes for an efficient resolution of computation requests. We show with a concrete example of Named Function networking (NFN), a computing framework based on Information Centric networking, that HYdrO can improve completion times of requests and distribute the load of the infrastructure.
the distributedcomputing system researches are active in various areas. It is the system to perform the operation in the various areas, for example, science and art and cryptography. We present security mechanism con...
详细信息
ISBN:
(纸本)9788955191387
the distributedcomputing system researches are active in various areas. It is the system to perform the operation in the various areas, for example, science and art and cryptography. We present security mechanism consisted of three phases: the simple authentication, the strong authentication and the rapid authentication. Additionally we designed the mechanism of scheduling for multi-job operation. Also, we show its results of implementation and evaluate its performance.
Scheduling algorithm designed for a bunch of tasks plays a significant role in affecting the performance of the cloud platform. At present, many scheduling algorithms mainly focus on optimizing system performance, whe...
详细信息
ISBN:
(纸本)9781479930463
Scheduling algorithm designed for a bunch of tasks plays a significant role in affecting the performance of the cloud platform. At present, many scheduling algorithms mainly focus on optimizing system performance, whereas whether users are satisfied withthe resource allocation is seldom considered. this paper presents a task scheduling algorithm based on user's satisfaction, proposing a suitable resource allocation method according to different users' need, thus improving users' satisfaction withthe cloud resources for which they pay. Finally, the scheduling algorithm is implemented and simulated on the CloudSim. the result demonstrates the effectiveness of the proposed algorithm.
Cloud computing has been more and more popular and widely used as a new model of information technology. In order to achieve a reliable and efficient operation of the cloud environment, it is important for cloud provi...
详细信息
ISBN:
(纸本)9780769547732
Cloud computing has been more and more popular and widely used as a new model of information technology. In order to achieve a reliable and efficient operation of the cloud environment, it is important for cloud providers to detect and deal with system anomalies in time. In this paper, we present a method for anomaly detection in MapReduce environment. this method is based on peer-similarity and uses density based clustering on OS-level metrics to perform real time analysis. the peer-similarity as well as our anomaly detection method is evaluated through experiments. Compared with other methods, the method proposed in this paper reflects the characteristics of simple, sensitive and efficient. And it can be deployed in both online and offline environment.
the proceedings contain 29 papers. the topics discussed include: encryption invalidation attacks: is your wi-fi encryption really working?;evaluation of effectiveness of MAC systems based on LSM for protecting IoT dev...
ISBN:
(纸本)9798350306705
the proceedings contain 29 papers. the topics discussed include: encryption invalidation attacks: is your wi-fi encryption really working?;evaluation of effectiveness of MAC systems based on LSM for protecting IoT devices;dual diagonal mesh: an optimal memory cube network under geometric constraints;multi-objective optimization of controller placement in distributed ONOS networks;solving the N-queens puzzle by a QUBO model with quadratic size;distributed MQTT brokers infrastructure with network transparent hardware broker;security risk visualization for open-source software based on vulnerabilities, repositories, and dependencies;pseudo-random number generation by staggered sampling of LFSR;issuer-revocable issuer-hiding attribute-based credentials using an accumulator;zero-knowledge proofs of connectivity for labeled directed graphs using bilinear-map accumulator;and auto-tuning mixed-precision computation by specifying multiple regions.
Grid computing provides a computational infrastructure supporting flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions, and resources. Which means the Grid should offer...
详细信息
Cloud virtualization and multi-tenant networking provide Infrastructure as a Service (IaaS) providers a new and innovative way to offer on-demand services to their customers, such as easy provisioning of new applicati...
详细信息
ISBN:
(纸本)9781538672358
Cloud virtualization and multi-tenant networking provide Infrastructure as a Service (IaaS) providers a new and innovative way to offer on-demand services to their customers, such as easy provisioning of new applications and better resource efficiency and scalability. However, existing data-intensive intelligent applications require more powerful processors, higher bandwidth and lower-latency networking service. In order to boost the performance of computing and networking services, as well as reduce the overhead of software virtualization, we propose a new data center network design based on OpenStack. Specifically, we map the OpenStack networking services to the hardware switch and utilize hardware-accelerated L2 switch and L3 routing to solve the software limitations, as well as achieve softwarelike scalability and flexibility. We design our prototype system via the Arista Software-Defined-networking (SDN) switch and provide an automatic script which abstracts the service layer that decouples OpenStack from the physical network infrastructure, thereby providing vendor-independence. We have evaluated the performance improvement in terms of bandwidth, delay, and system resource utilization using various tools and under various Quality-of-Service (QoS) constraints. Our solution demonstrates improved cloud scaling and network efficiency via only one touch point to control all vendors' devices in the data center.
Transactional memory (TM) is a parallel programming concept which reduces challenges in parallel programming. Existing distributed transactional memory system consumes too much bandwidth and brings high latency. In th...
详细信息
暂无评论