java - Hadoop: Measuring the duration of each phase(map, shuffle/sort, reduce) -
there's similar question want know. how can measure duration of each phase(map, shuffle/sort, reduce) in hadoop? answer says web/ui of tasktracker shows each duration of application. environment hadoop-2.2.0 , there's no tasktracker. tasktracker web/ui "localhost:50030/tasktracker.jsp" not working. answer appropriate lower version of hadoop(1.x.x), guess.
how can measure duration of each phase(map, shuffle/sort, reduce) in hadoop-2.x.x version? there other web/ui check them?
my environment: red hat 6.3, hadoop-2.2.0.
this information can seen via jobhistory
url http://localhost:19888/jobhistory
.click on "job id" "retired job" list , show average map,reduce,shuffle , merge time job. if click on map or reduce tasks can see details each task's start , end time.
Comments
Post a Comment