HFSP: Bringing Size-Based Scheduling To Hadoop
| Author(s) | : | Minal Sable, Tanmayee Sathe, Vibhawari Jawale, Aashish Ramdasi |
| Institution | : | Department of Computer Engineering, SAOE(Kondhwa) |
| Published In | : | Vol. 3, Issue 13 — January 2016 |
| Page No. | : | - |
| Domain | : | Engineering |
| Type | : | Research Paper |
| ISSN (Online) | : | 2348-4470 |
| ISSN (Print) | : | 2348-6406 |
Size-based scheduling is becoming older day by day, it has been recognized as an powerfull approach toassure fairness and near optimal system response time.We introduce HFSP, a scheduler acquainting this technique toHadoop which real, multi-server, complex and widely used system.Initial job information is needed in sized based scheduling, which is not available in hadoop. HFSP developssuch information by evaluating it on-line during job execution.Our experiments, which are based on realistic workloads generated via standard benchmarking suite,recognizes a significant decrease in a system response time by using Hadoop Fair Scheduler, and reflects that HFSP islargely tolerant to job size estimation.
Minal Sable, Tanmayee Sathe, Vibhawari Jawale, Aashish Ramdasi, “HFSP: Bringing Size-Based Scheduling To Hadoop”, International Journal of Advance Engineering and Research Development (IJAERD), Vol. 3, Issue 13, pp. -, January 2016.
