Migration-Aware Genetic Optimization for MapReduce Scheduling and Replica Placement in Hadoop
Publication type: Journal Article
Publication date: 2018-02-14
scimago Q2
wos Q2
SJR: 0.734
CiteScore: 7.2
Impact factor: 2.9
ISSN: 15707873, 15729184
Hardware and Architecture
Information Systems
Computer Networks and Communications
Software
Abstract
This work addresses the optimization of file locality, file availability, and replica migration cost in a Hadoop architecture. Our optimization algorithm is based on the Non-dominated Sorting Genetic Algorithm-II and it simultaneously determines file block placement, with a variable replication factor, and MapReduce job scheduling. Our proposal has been tested with experiments that considered three data center sizes (8, 16 and 32 nodes) with the same workload and number of files (150 files and 3519 file blocks). In general terms, the use of a placement policy with a variable replica factor obtains higher improvements for our three optimization objectives. On the contrary, the use of a job scheduling policy only improves these objectives when it is used along a variable replication factor. The results have also shown that the migration cost is a suitable optimization objective as significant improvements up to 34% have been observed between the experiments.
Found
Nothing found, try to update filter.
Found
Nothing found, try to update filter.
Top-30
Journals
|
1
2
3
4
|
|
|
Journal of Grid Computing
4 publications, 15.38%
|
|
|
Concurrency Computation Practice and Experience
3 publications, 11.54%
|
|
|
Journal of Supercomputing
2 publications, 7.69%
|
|
|
Information Sciences
2 publications, 7.69%
|
|
|
Future Generation Computer Systems
2 publications, 7.69%
|
|
|
IEEE Transactions on Parallel and Distributed Systems
2 publications, 7.69%
|
|
|
ACM Transactions on Modeling and Performance Evaluation of Computing Systems
1 publication, 3.85%
|
|
|
Wireless Personal Communications
1 publication, 3.85%
|
|
|
Journal of Network and Computer Applications
1 publication, 3.85%
|
|
|
Advances in Intelligent Systems and Computing
1 publication, 3.85%
|
|
|
Journal of Intelligent and Fuzzy Systems
1 publication, 3.85%
|
|
|
1
2
3
4
|
Publishers
|
1
2
3
4
5
6
7
8
|
|
|
Springer Nature
8 publications, 30.77%
|
|
|
Elsevier
5 publications, 19.23%
|
|
|
Institute of Electrical and Electronics Engineers (IEEE)
4 publications, 15.38%
|
|
|
Wiley
3 publications, 11.54%
|
|
|
Association for Computing Machinery (ACM)
1 publication, 3.85%
|
|
|
IOS Press
1 publication, 3.85%
|
|
|
1
2
3
4
5
6
7
8
|
- We do not take into account publications without a DOI.
- Statistics recalculated weekly.
Are you a researcher?
Create a profile to get free access to personal recommendations for colleagues and new articles.
Metrics
26
Total citations:
26
Citations from 2024:
1
(3.85%)
Cite this
GOST |
RIS |
BibTex |
MLA
Cite this
GOST
Copy
GUERRERO C., Lera I., Juiz C. Migration-Aware Genetic Optimization for MapReduce Scheduling and Replica Placement in Hadoop // Journal of Grid Computing. 2018. Vol. 16. No. 2. pp. 265-284.
GOST all authors (up to 50)
Copy
GUERRERO C., Lera I., Juiz C. Migration-Aware Genetic Optimization for MapReduce Scheduling and Replica Placement in Hadoop // Journal of Grid Computing. 2018. Vol. 16. No. 2. pp. 265-284.
Cite this
RIS
Copy
TY - JOUR
DO - 10.1007/s10723-018-9432-8
UR - https://doi.org/10.1007/s10723-018-9432-8
TI - Migration-Aware Genetic Optimization for MapReduce Scheduling and Replica Placement in Hadoop
T2 - Journal of Grid Computing
AU - GUERRERO, CARLOS
AU - Lera, Isaac
AU - Juiz, Carlos
PY - 2018
DA - 2018/02/14
PB - Springer Nature
SP - 265-284
IS - 2
VL - 16
SN - 1570-7873
SN - 1572-9184
ER -
Cite this
BibTex (up to 50 authors)
Copy
@article{2018_GUERRERO,
author = {CARLOS GUERRERO and Isaac Lera and Carlos Juiz},
title = {Migration-Aware Genetic Optimization for MapReduce Scheduling and Replica Placement in Hadoop},
journal = {Journal of Grid Computing},
year = {2018},
volume = {16},
publisher = {Springer Nature},
month = {feb},
url = {https://doi.org/10.1007/s10723-018-9432-8},
number = {2},
pages = {265--284},
doi = {10.1007/s10723-018-9432-8}
}
Cite this
MLA
Copy
GUERRERO, CARLOS, et al. “Migration-Aware Genetic Optimization for MapReduce Scheduling and Replica Placement in Hadoop.” Journal of Grid Computing, vol. 16, no. 2, Feb. 2018, pp. 265-284. https://doi.org/10.1007/s10723-018-9432-8.