dev  

Messages by Thread

• [jira] [Created] (TEZ-3777) Avoid buffer copies by passing RLE flag to TezMerger from PipelinedSorter Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3776) ShuffleHandler can theoretically NPE if all partitions in the ranged fetch are empty Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3775) Tez UI: Show DAG context in document title Jonathan Eagles (JIRA)
• [jira] [Created] (TEZ-3774) hive use tez engine occur org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) xujie (JIRA)
• [jira] [Created] (TEZ-3773) Tez build failed KaiXu (JIRA)
• [jira] [Created] (TEZ-3772) Allow slowstart for small jobs to be treated differently Muhammad Samir Khan (JIRA)
• [jira] [Created] (TEZ-3771) Tez UI: WASB/ADLS counters should be listed on the Tez UI Sreenath Somarajapuram (JIRA)
• [jira] [Created] (TEZ-3770) DAG-aware YARN task scheduler Jason Lowe (JIRA)
• [jira] [Created] (TEZ-3769) Unordered: Fix wrong stats being sent out in the last event when final merge is disabled Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3768) Test timeout value for TestShuffleHandlerJobs is low Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3767) Shuffle should not report error to AM during inputContext.killSelf() Rajesh Balamohan (JIRA)
• Tez-Build failing Jonathan Eagles
  • Re: Tez-Build failing Siddharth Seth
• [jira] [Created] (TEZ-3766) Tez Aux-services : Clean up shaded jar to not include default config xml files and yarn-client pieces Kuhu Shukla (JIRA)
• Build failed in Jenkins: Tez-Build-branch-TEZ-2980 #35 Apache Jenkins Server
• Build failed in Jenkins: Tez-Build-branch-0.8 #89 Apache Jenkins Server
• [jira] [Created] (TEZ-3765) Tez UI: Add query.name/dag.name to the all queries page Prasanth Jayachandran (JIRA)
• [jira] [Created] (TEZ-3764) Tez UI: DAG failed but status shows error Prasanth Jayachandran (JIRA)
• [jira] [Created] (TEZ-3763) Tez UI: Filter DAG by status does not work Prasanth Jayachandran (JIRA)
• [jira] [Created] (TEZ-3762) When final merge is disabled in unordered case, it should create index file instead of relying on cache Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3761) NPE in Fetcher under load Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3760) Tez AUX Services: Shading needs to filter SIG files Gopal V (JIRA)
• [jira] [Created] (TEZ-3759) Consider writing index and out file (for shuffle) in the same disk Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3758) Vertex can hang in RUNNING state when two task attempts finish very closely and have retroactive failures Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3757) Integer overflow in PipelinedSorter Travis Woodruff (JIRA)
• [jira] [Created] (TEZ-3756) Tez Query fails because of a weed node and all four attempts are placed on same node Prabhu Joseph (JIRA)
• [jira] [Created] (TEZ-3755) Capture distanceFromRoot and high/low priorities for the vertex in ATS Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3754) With large ordered fetches, stalling shuffle could create pressure on server side Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3753) Improve error message in IFile for buffer length overflow Muhammad Samir Khan (JIRA)
• [jira] [Created] (TEZ-3752) Reduce Object size of InMemoryMapOutput for large jobs Jonathan Eagles (JIRA)
• Build failed in Jenkins: Tez-Build #1710 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1711 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1712 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1713 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1714 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1715 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1716 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1717 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1718 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1719 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1720 Apache Jenkins Server
• Build failed in Jenkins: Tez-Build #1705 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1706 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1707 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1708 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1709 Apache Jenkins Server
• [jira] [Created] (TEZ-3751) Add test cases to verify DeletionTracker behavior for dag deletion. Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3750) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput. Harish Jaiprakash (JIRA)
• [jira] [Created] (TEZ-3749) MRRSleep does not start in hadoop 3. Harish Jaiprakash (JIRA)
• [jira] [Created] (TEZ-3748) TestExternalTezServicesErrors#testNonFatalErrors and TestSpeculation#testBasicSpeculationWithoutProgress fail intermittently Kuhu Shukla (JIRA)
• Build failed in Jenkins: Tez-Build #1703 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1704 Apache Jenkins Server
• [jira] [Resolved] (TEZ-3712) Use Local FileContext for deleting dag level directories Jonathan Eagles (JIRA)
• [DISCUSS] Release 0.9.0 Siddharth Seth
  • Re: [DISCUSS] Release 0.9.0 zhiyuan yang
  • Re: [DISCUSS] Release 0.9.0 Siddharth Seth
  • Re: [DISCUSS] Release 0.9.0 Jonathan Eagles
  • Re: [DISCUSS] Release 0.9.0 Siddharth Seth
  • Re: [DISCUSS] Release 0.9.0 Siddharth Seth
  • Re: [DISCUSS] Release 0.9.0 zhiyuan yang
• [jira] [Created] (TEZ-3747) TezConstants.TEZ_SHUFFLE_HANDLER_SERVICE_ID is referenced in Hive Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3746) TestExceptionPropagation#testExceptionPropagationSession fails intermittently Sneha Kanekar (JIRA)
• [jira] [Created] (TEZ-3745) Change master to required java 8 Siddharth Seth (JIRA)
• [jira] [Resolved] (TEZ-3743) TestTaskCommunicatorContextImpl throws NullPointerException after TEZ-3334 merge Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3744) Findbug warnings after TEZ-3334 merge Jason Lowe (JIRA)
• [jira] [Created] (TEZ-3743) TestTaskCommunicatorContextImpl throws NullPointerException after TEZ-3334 merge Jonathan Eagles (JIRA)
• [jira] [Resolved] (TEZ-3742) Fix AMContainerHelpers#createCommonContainerLaunchContext to not pass localResources. Jonathan Eagles (JIRA)
• [jira] [Created] (TEZ-3742) Fix AMContainerHelpers#createCommonContainerLaunchContext to not pass localResources. Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3741) Tez outputs should free memory when closed Jason Lowe (JIRA)
• [jira] [Resolved] (TEZ-3738) TestUnorderedPartitionedKVWriter fails due to RejectedExecutionException Jason Lowe (JIRA)
• Build failed in Jenkins: Tez-Build #1697 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1698 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1699 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1700 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1701 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1702 Apache Jenkins Server
• [jira] [Resolved] (TEZ-3740) Clean up TEZ-3334-CHANGES.txt Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3740) Clean up TEZ-3334-CHANGES.txt Jonathan Eagles (JIRA)
• [jira] [Resolved] (TEZ-3735) Test failures in TestTaskAttempt and TestAMContainerMap Jonathan Eagles (JIRA)
• [jira] [Created] (TEZ-3739) Fair CartesianProduct doesn't works well with huge difference in output size Zhiyuan Yang (JIRA)
• [jira] [Created] (TEZ-3738) TestUnorderedPartitionedKVWriter fails due to RejectedExecutionException Jason Lowe (JIRA)
• Build failed in Jenkins: Tez-Build #1694 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1695 Apache Jenkins Server
• [jira] [Created] (TEZ-3737) Fair cartesian product vertex mananger didn't use correct Zhiyuan Yang (JIRA)
• [jira] [Created] (TEZ-3736) SubmittedDAGs is always 0 in Resource Manager UI Artem Velykorodnyi (JIRA)
• [jira] [Created] (TEZ-3735) Test failures in TestTaskAttempt and TestAMContainerMap Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3734) Add TEZ_RUNTIME_UNORDERED_PARTITIONED_KVWRITER_BUFFER_MERGE_PERCENT to UnorderedKVInput. Harish Jaiprakash (JIRA)
• [VOTE] Merge TEZ-3334 into master Jonathan Eagles
  • Re: [VOTE] Merge TEZ-3334 into master Siddharth Seth
  • Re: [VOTE] Merge TEZ-3334 into master Kuhu Shukla
  • Re: [VOTE] Merge TEZ-3334 into master Jason Lowe
  • Re: [VOTE] Merge TEZ-3334 into master Eric Badger
  • Re: [VOTE] Merge TEZ-3334 into master Ming Ma
  • Re: [VOTE] Merge TEZ-3334 into master Jonathan Eagles
  • Re: [VOTE] Merge TEZ-3334 into master Jonathan Eagles
  • Re: [VOTE] Merge TEZ-3334 into master Jonathan Eagles
• Re: [DISCUSS] Merge TEZ-3334 to master Jonathan Eagles
• [jira] [Created] (TEZ-3733) Auto-Reduce Parallelism needs to consider shuffle overhead to avoid OOM Jonathan Eagles (JIRA)
• [jira] [Resolved] (TEZ-3726) Clean up DeletionTracker's reflection instantiation and provide ContainerLauncher with dagComplete() functionality Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3732) Reduce Object size of InputAttemptIdentifier and MapOutput for large jobs Jonathan Eagles (JIRA)
• Build failed in Jenkins: Tez-Build #1690 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1691 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1692 Apache Jenkins Server
• [jira] [Resolved] (TEZ-3731) Add committer kshukla to Tez Team List Kuhu Shukla (JIRA)
• [jira] [Resolved] (TEZ-3729) Use a new abstract class for ContainerLauncher(s) that provide dagComplete() functionality Kuhu Shukla (JIRA)
• [jira] [Resolved] (TEZ-3725) Cleanup http connections and other unnecessary fields in DAG Deletion tracker classes. Kuhu Shukla (JIRA)
• PreCommit-TEZ-Build issue Jonathan Eagles
  • Re: PreCommit-TEZ-Build issue Siddharth Seth
  • Re: PreCommit-TEZ-Build issue Jonathan Eagles
• [jira] [Created] (TEZ-3731) Add committer kshukla to Tez Team List Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3730) Lower logging level in UnorderedPartitionedKVWriter Prasanth Jayachandran (JIRA)
• [jira] [Created] (TEZ-3729) Use a new abstract class for ContainerLauncher(s) that provide dagComplete() functionality Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3728) When using HDFS federation, setting tez.simple.history.logging.dir to viewfs:// causes AM to fail Chen Xi (JIRA)
• [jira] [Created] (TEZ-3727) When using HDFS federation, token of tez.simple.history.logging.dir is not added, causing AM to fail Chen Xi (JIRA)
• Build failed in Jenkins: Tez-Build #1686 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1687 Apache Jenkins Server
• Build failed in Jenkins: Tez-Build #1683 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1684 Apache Jenkins Server
• [jira] [Created] (TEZ-3726) DeletionTracker's reflections instantiation should be simpler and generic. Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3725) Cleanup http connections and other unnecessary fields in DAG Deletion tracker classes. Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3724) Tez UI on HTTP "corrects" HTTPS REST calls to HTTP Jonathan Eagles (JIRA)
• Build failed in Jenkins: Tez-Build #1681 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1682 Apache Jenkins Server
• [jira] [Created] (TEZ-3723) TezIndexRecord#hasData() returns true for empty index record in the Unordered case Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3722) Have MultiMROutput support different configurations for different writers Ming Ma (JIRA)
• [jira] [Created] (TEZ-3721) Extend CallableWithNdc to also clone MDC Prasanth Jayachandran (JIRA)
• [jira] [Created] (TEZ-3720) Optimize SimpleHistoryLoggingService: FileSystem$Stats updates are expensive than writes Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3719) DAGImpl.computeProgress slows down dispatcher and ipc threads Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3718) Better handling of 'bad' nodes Siddharth Seth (JIRA)
• [jira] [Resolved] (TEZ-3711) tez-yarn-timeline-history-with-fs fails to build against hadoop3 Siddharth Seth (JIRA)
• [jira] [Created] (TEZ-3717) Master does not compile with -Phadoop28. Harish Jaiprakash (JIRA)
• [jira] [Created] (TEZ-3716) Allow DAGSchedulerNaturalOrder* to provide the same value for priorityLow and priorityHigh Siddharth Seth (JIRA)
• [jira] [Created] (TEZ-3715) Differentiate between TaskAttempt submission and TaskAttempt started Siddharth Seth (JIRA)
• Build failed in Jenkins: Tez-Build #1679 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1680 Apache Jenkins Server
• [jira] [Created] (TEZ-3714) Tez UI: Hive Queries page: Use Dag ID and App ID if they are published form Hive side. Sreenath Somarajapuram (JIRA)
• Build failed in Jenkins: Tez-Build-branch-0.7 #186 Apache Jenkins Server
• [jira] [Created] (TEZ-3713) Allow dag level deletion in cases where containers are reused Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3712) Use Local FileContext for deleting dag level directories Kuhu Shukla (JIRA)
• [jira] [Reopened] (TEZ-3700) Consumer attempt should kill itself instead of failing during validation checks with final merge avoidance Siddharth Seth (JIRA)
• [jira] [Resolved] (TEZ-3247) Tez does not compile against hadoop-trunk Harish Jaiprakash (JIRA)
• Build failed in Jenkins: Tez-Build-branch-0.8 #85 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-branch-0.8 #86 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-branch-0.8 #87 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-branch-0.8 #88 Apache Jenkins Server
• [jira] [Resolved] (TEZ-3705) Modify DeletionTracker and deletion threads to be initialized only if enabled for tez_shuffle Jonathan Eagles (JIRA)
• [jira] [Created] (TEZ-3711) tez-yarn-timeline-history-with-fs fails to build against hadoop3 Siddharth Seth (JIRA)
• [jira] [Reopened] (TEZ-3252) [Umbrella] Enable support for Hadoop-3.x Siddharth Seth (JIRA)
• [jira] [Resolved] (TEZ-3710) InMemoryReader has a lock per-byte Gopal V (JIRA)
• [jira] [Created] (TEZ-3710) InMemoryReader has a lock per-byte Gopal V (JIRA)
• [DISCUSS] Move master (0.9) to use Java 8 as the minimum version Siddharth Seth
  • Re: [DISCUSS] Move master (0.9) to use Java 8 as the minimum version zhiyuan yang
  • Re: [DISCUSS] Move master (0.9) to use Java 8 as the minimum version Hitesh Shah
  • Re: [DISCUSS] Move master (0.9) to use Java 8 as the minimum version Siddharth Seth
• Build failed in Jenkins: Tez-Build-Hadoop3 #6 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-Hadoop3 #7 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-Hadoop3 #8 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-Hadoop3 #9 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-Hadoop3 #10 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-Hadoop3 #11 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build-Hadoop3 #12 Apache Jenkins Server
• [jira] [Created] (TEZ-3709) TezMerger is slow for high number of segments Jonathan Eagles (JIRA)
• [jira] [Created] (TEZ-3708) Arbitrary parallelism for unpartitioned cartesian product regardless of # src tasks Zhiyuan Yang (JIRA)
• Build failed in Jenkins: Tez-Build #1674 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1675 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1676 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1677 Apache Jenkins Server
• [jira] [Created] (TEZ-3707) TezSharedExecutor race condition in awaitTermination vs isTerminated. Harish Jaiprakash (JIRA)
• Jenkins build against Hadoop-3 Siddharth Seth
• [jira] [Created] (TEZ-3706) add option to skip Tez UI build Sergey Shelukhin (JIRA)
• [jira] [Created] (TEZ-3705) Modify DeletionTracker and deletion threads to be initialized only if enabled for tez_shuffle Kuhu Shukla (JIRA)
• [jira] [Created] (TEZ-3704) Tez-UI unit test failing Yesha Vora (JIRA)
• [jira] [Created] (TEZ-3703) Use a sha comparison to compare vertex and dag resources, if there is a mismatch Siddharth Seth (JIRA)
• [jira] [Resolved] (TEZ-3702) Tez shuffle jar includes service loader entry for ClientProtocolProvider but not the corresponding class Jason Lowe (JIRA)
• [jira] [Created] (TEZ-3702) Tez shuffle jar includes service loader entry for ClientProtocolProvider but not the corresponding class Jason Lowe (JIRA)
• [jira] [Created] (TEZ-3701) UnorderedPartitionedKVWriter does not wait for submitted tasks to finish before finalMerge. Harish Jaiprakash (JIRA)
• Build failed in Jenkins: Tez-Build #1672 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1673 Apache Jenkins Server
• [jira] [Created] (TEZ-3700) Consumer attempt should kill itself instead of failing during validation checks with final merge avoidance Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3699) For large dataset, pipelined shuffle throws exceptions in consumer side for UnorderedPartitioned edge Rajesh Balamohan (JIRA)
• Build failed in Jenkins: Tez-Build-Hadoop3 #1 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build-Hadoop3 #2 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build-Hadoop3 #3 Apache Jenkins Server
• [jira] [Resolved] (TEZ-3685) ShuffleHandler completedInputSet off-by-one error Jonathan Eagles (JIRA)
• [jira] [Created] (TEZ-3698) UnorderedKV writer should be able to honor tez.runtime.enable.final-merge.in.output without pipelinedshuffle Rajesh Balamohan (JIRA)
• [jira] [Created] (TEZ-3697) Adding #output_record in vertex manager event payload Zhiyuan Yang (JIRA)
• [jira] [Created] (TEZ-3696) Jobs can hang when both concurrency and speculation are enabled Eric Badger (JIRA)
• [jira] [Created] (TEZ-3695) TestTezSharedExecutor fails sporadically Jason Lowe (JIRA)
• [jira] [Created] (TEZ-3694) Adopt YARN-5007 in MiniTezCluster Zhiyuan Yang (JIRA)
• Build failed in Jenkins: Tez-Build #1669 Apache Jenkins Server
  • Build failed in Jenkins: Tez-Build #1670 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1671 Apache Jenkins Server
• [jira] [Created] (TEZ-3693) ControlledClock is not used Jason Lowe (JIRA)
• Jenkins build is back to normal : Tez-Build-branch-0.8 #84 Apache Jenkins Server
• [jira] [Created] (TEZ-3692) VertexStatistics shouldn't be null even no task completed Zhiyuan Yang (JIRA)
• Build failed in Jenkins: Tez-Build #1667 Apache Jenkins Server
  • Jenkins build is back to normal : Tez-Build #1668 Apache Jenkins Server
• [jira] [Created] (TEZ-3691) Move pipelined sorter to use the framework ExecutorService. Harish Jaiprakash (JIRA)
• [jira] [Created] (TEZ-3690) Tez on hadoop 3 build failed due to hdfs client/server jar separation Junping Du (JIRA)
• [jira] [Created] (TEZ-3689) Change minimum hadoop version to 2.7.0 Siddharth Seth (JIRA)

• Later messages