chamikaramj commented on issue #21645: URL: https://github.com/apache/beam/issues/21645#issuecomment-1634920142
An example failed job: https://pantheon.corp.google.com/dataflow/jobs/us-central1/2023-07-13_07_35_25-3670419731370821100;bottomTab=WORKER_LOGS;logsSeverity=INFO;graphView=0?project=apache-beam-testing&pageState=(%22dfTime%22:(%22l%22:%22dfJobMaxTime%22))&e=13802955&jsmode=O&mods=logs_tg_staging Check failed: absl::OkStatus() == ::dist_proc::dax::PrintableStatus(status) (OK vs. generic::failed_precondition: PaneInfo truncated passed through: ==> dist_proc/dax/workflow/worker/io/fnapi_coders.cc:122 ==> dist_proc/dax/workflow/worker/io/fnapi_coders.cc:1590) *** Check failure stack trace: *** @ 0x557732592b44 absl::log_internal::LogMessage::SendToLog() @ 0x557732592762 absl::log_internal::LogMessage::Flush() @ 0x557732592e89 absl::log_internal::LogMessageFatal::~LogMessageFatal() @ 0x5577313803fd dist_proc::dax::workflow::FnApiProcessBundleOperator::ProcessOutputElements() @ 0x5577317739fb dist_proc::dax::workflow::FnDataService::DataHandle::HandleInboundData() @ 0x557731772f8b dist_proc::dax::workflow::FnDataService::HandleInboundData() @ 0x5577313f86c3 dist_proc::dax::workflow::FnApiServiceImpl::BundleHandleImpl::WaitToFinish() @ 0x557731384cb6 dist_proc::dax::workflow::FnApiProcessBundleOperator::Finish() @ 0x5577313ea4fd dist_proc::dax::workflow::GraphWorkExecutor::Execute() @ 0x5577313e28db dist_proc::dax::workflow::InstructionGraphExecutor::Run() @ 0x5577315e037a dist_proc::dax::workflow::ParallelWorkflowWorkerTask::ProcessWork() @ 0x5577315e4da4 std::__u::__function::__policy_invoker<>::__call_impl<>() @ 0x5577315e43b4 absl::internal_any_invocable::LocalInvoker<>() @ 0x55773246e59f Thread::ThreadBody() @ 0x7f9af6ecc4e8 start_thread @ 0x7f9af6d4122d clone Seems like UW is failing. I think there was a recent fix to UW related to this that is not in prod yet. cc: @robertwb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
