[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729871#comment-17729871
]
Quanlong Huang commented on IMPALA-532:
---
We now print the locale at startup:
{code:cpp}
LOG(INFO) << "Using locale: " << std::locale("").name(); {code}
[https://github.com/apache/impala/blob/4cf0bfa83f9641eb95d83c76af7962e6a3f1e064/be/src/common/init.cc#L497]
We can capture the error there and print the effective locale name with a
meaningful exit message. Admins then can check whether the specific locale is
missing on the node and install it if missing.
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Assignee: Pranav Yogi Lodha
>Priority: Major
> Labels: newbie, ramp-up, supportability
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209848#comment-17209848
]
Tim Armstrong commented on IMPALA-532:
--
[~thundergun] yeah please feel free to pick it up.
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Major
> Labels: newbie, ramp-up, supportability
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209822#comment-17209822
]
Vincent Tran commented on IMPALA-532:
-
I can take this on if it's not too urgent. Since there's no foreseeable fix to
allow Impala to "tolerate bad locale settings", I can change the objective of
this ticket to "Impala should fail gracefully on bad locale settings". Sounds
good?
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Major
> Labels: newbie, ramp-up, supportability
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209717#comment-17209717
]
Tim Armstrong commented on IMPALA-532:
--
[~thundergun] looks like we could detect this by instantiating std::locale("")
and catching the exception, then failing with a fatal error - that is what
boost is doing here -
https://github.com/boostorg/filesystem/blob/boost-1.61.0/src/path.cpp#L906.
Here's a minimal c++ program that can reproduce the uncaught exception.
{code}
#include
int main() {
std::locale loc("");
return 0;
}
{code}
{noformat}
tarmstrong@tarmstrong-Precision-7540:~$ g++ locale.cc -o locale && LC_ALL="bad
local" ./locale
terminate called after throwing an instance of 'std::runtime_error'
what(): locale::facet::_S_create_c_locale name not valid
Aborted (core dumped)
tarmstrong@tarmstrong-Precision-7540:~$ g++ locale.cc -o locale && LC_ALL=""
./locale
OK
{noformat}
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Minor
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209702#comment-17209702
]
Tim Armstrong commented on IMPALA-532:
--
Looks like we upgraded past 1.47 a long time ago.
http://gerrit.cloudera.org:8080/427
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Minor
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208849#comment-17208849
]
Vincent Tran commented on IMPALA-532:
-
It does take a minidump to lead me to this Jira. It'd be useful to print a
fatal-level message into the log if Impala can detect invalid locale.
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Minor
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208847#comment-17208847
]
Vincent Tran commented on IMPALA-532:
-
This still occurs on Impala 3.1.0 by the way. Has boost not been upgraded since?
{noformat}
0 libc-2.22.so + 0x34fd7
1 libc-2.22.so + 0x363aa
2 ld-2.22.so + 0x14f60
3 libstdc++.so.6 + 0x78110
4 libstdc++.so.6!_fini + 0x2510
5 libstdc++.so.6!_fini + 0x2d5b
6 libc-2.22.so + 0x75cc7
7 libc-2.22.so + 0x75cc7
8 libstdc++.so.6!__gnu_cxx::__verbose_terminate_handler() [vterminate.cc : 95
+ 0x5]
9 libstdc++.so.6!__cxxabiv1::__terminate(void (*)()) [eh_terminate.cc : 47 +
0x2]
10 libstdc++.so.6!std::terminate() [eh_terminate.cc : 57 + 0xd]
11 libstdc++.so.6!__cxxabiv1::__cxa_throw [eh_throw.cc : 87 + 0x5]
12 libstdc++.so.6!std::__throw_runtime_error(char const*) [functexcept.cc : 107
+ 0x16]
13 libstdc++.so.6!std::locale::facet::_S_create_c_locale(__locale_struct*&,
char const*, __locale_struct*) [c++locale.cc : 137 + 0xc]
14 libstdc++.so.6!std::locale::_Impl::_Impl(char const*, unsigned long)
[localename.cc : 182 + 0xa]
15 libstdc++.so.6!std::locale::locale(char const*) [localename.cc : 128 + 0x18]
16 impalad!boost::filesystem::path::codecvt() + 0x53
17 impalad!impala::HdfsScanNodeBase::Prepare(impala::RuntimeState*)
[hdfs-scan-node-base.cc : 209 + 0x5]
18 impalad!impala::HdfsScanNode::Prepare(impala::RuntimeState*)
[hdfs-scan-node.cc : 159 + 0x15]
19 impalad!impala::FragmentInstanceState::Prepare() [fragment-instance-state.cc
: 207 + 0x18]
20 impalad!impala::FragmentInstanceState::Exec() [fragment-instance-state.cc :
75 + 0x5]
21 impalad!impala::QueryState::ExecFInstance(impala::FragmentInstanceState*)
[query-state.cc : 478 + 0xf]
22 impalad!impala::Thread::SuperviseThread(std::string const&, std::string
const&, boost::function, impala::ThreadDebugInfo const*,
impala::Promise*) [function_template.hpp : 767 +
0x7]
23 impalad!boost::detail::thread_data,
impala::ThreadDebugInfo const*, impala::Promise*), boost::_bi::list5,
boost::_bi::value, boost::_bi::value >,
boost::_bi::value,
boost::_bi::value*> > > >::run()
[bind.hpp : 525 + 0x6]
24 impalad!thread_proxy + 0xda
25 libpthread-2.22.so + 0x874a
26 libc-2.22.so + 0xecf6d{noformat}
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Minor
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> + '[' statestore = statestore ']'
> + exec
> /opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/../../bin/statestored
> --flagfile=/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> terminate called after throwing an instance of 'std::runtime_error'
> what(): locale::facet::_S_create_c_locale name not valid
> {code}
> It should fall back to the standard locale ("C"), if the user's locale is
> messed up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785091#comment-16785091
]
Tim Armstrong commented on IMPALA-532:
--
Backtrace:
{noformat}
(gdb) bt
#0 0x7f7e9798c428 in raise () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x7f7e9798e02a in abort () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x7f7e984ec84d in __gnu_cxx::__verbose_terminate_handler() ()
from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#3 0x7f7e984ea6b6 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#4 0x7f7e984ea701 in std::terminate() () from
/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#5 0x7f7e984ea919 in __cxa_throw () from
/usr/lib/x86_64-linux-gnu/libstdc++.so.6
#6 0x7f7e985135af in std::__throw_runtime_error(char const*) ()
from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#7 0x7f7e9850d714 in
std::locale::facet::_S_create_c_locale(__locale_struct*&, char const*,
__locale_struct*) () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#8 0x7f7e984fe26c in std::locale::_Impl::_Impl(char const*, unsigned long)
()
from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#9 0x7f7e984fed8d in std::locale::locale(char const*) ()
from /usr/lib/x86_64-linux-gnu/libstdc++.so.6
#10 0x0374d613 in boost::filesystem::path::codecvt() ()
#11 0x023026b1 in impala::HdfsScanNodeBase::Prepare (this=0xcc24a00,
state=0xdc74840)
at be/src/exec/hdfs-scan-node-base.cc:210
#12 0x022fa15d in impala::HdfsScanNode::Prepare (this=0xcc24a00,
state=0xdc74840)
at be/src/exec/hdfs-scan-node.cc:162
#13 0x022e36f5 in impala::ExecNode::Prepare (this=0xc02cac0,
state=0xdc74840)
at be/src/exec/exec-node.cc:122
#14 0x0240eb14 in impala::AggregationNodeBase::Prepare (this=0xc02cac0,
state=0xdc74840) at be/src/exec/aggregation-node-base.cc:60
#15 0x01f566ff in impala::FragmentInstanceState::Prepare
(this=0xcbdc340)
at be/src/runtime/fragment-instance-state.cc:208
#16 0x01f54f38 in impala::FragmentInstanceState::Exec (this=0xcbdc340)
at be/src/runtime/fragment-instance-state.cc:73
#17 0x01f68676 in impala::QueryState::ExecFInstance (this=0xd6a3200,
fis=0xcbdc340)
at be/src/runtime/query-state.cc:630
#18 0x01f66958 in impala::QueryStateoperator()(void)
const (
__closure=0x7f7def247ca8) at be/src/runtime/query-state.cc:539
#19 0x01f69ab7 in
boost::detail::function::void_function_obj_invoker0,
void>::invoke(boost::detail::function::function_buffer &)
(function_obj_ptr=...)
at
/opt/Impala-Toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:153
#20 0x01d7be62 in boost::function0::operator()
(this=0x7f7def247ca0)
at
/opt/Impala-Toolchain/boost-1.57.0-p3/include/boost/function/function_template.hpp:767
#21 0x0224a95f in impala::Thread::SuperviseThread(std::string const&,
std::string const&, boost::function, impala::ThreadDebugInfo const*,
impala::Promise*) (name=..., category=...,
functor=..., parent_thread_info=0x7f7df0249950,
thread_started=0x7f7df02488f0) at be/src/util/thread.cc:359
#22 0x02252ce3 in boost::_bi::list5,
boost::_bi::value, boost::_bi::value >,
boost::_bi::value,
boost::_bi::value*>
>::operator(), impala::ThreadDebugInfo const*, impala::Promise*), boost::_bi::list0>(boost::_bi::type, void
(*&)(std::string const&, std::string const&, boost::function,
impala::ThreadDebugInfo const*, impala::Promise*), boost::_bi::list0&, int) (this=0xd6765c0,
f=@0xd6765b8: 0x224a5f8 , impala::ThreadDebugInfo
const*, impala::Promise*)>, a=...)
at /opt/Impala-Toolchain/boost-1.57.0-p3/include/boost/bind/bind.hpp:525
#23 0x02252c07 in boost::_bi::bind_t, impala::ThreadDebugInfo const*,
impala::Promise*),
boost::_bi::list5,
boost::_bi::value, boost::_bi::value >,
boost::_bi::value,
boost::_bi::value*> >
>::operator()() (
this=0xd6765b8)
at
/opt/Impala-Toolchain/boost-1.57.0-p3/include/boost/bind/bind_template.hpp:20
#24 0x02252bca in boost::detail::thread_data,
impala::ThreadDebugInfo const*, impala::Promise*), boost::_bi::list5,
boost::_bi::value, boost::_bi::value >,
boost::_bi::value,
boost::_bi::value*> > > >::run()
(this=0xd676400)
at
/opt/Impala-Toolchain/boost-1.57.0-p3/include/boost/thread/detail/thread.hpp:116
#25 0x0371e9ba in thread_proxy ()
#26 0x7f7e97d286ba in start_thread () from
/lib/x86_64-linux-gnu/libpthread.so.0
#27 0x7f7e97a5e41d in clone () from /lib/x86_64-linux-gnu/libc.so.6
{noformat}
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>
[jira] [Commented] (IMPALA-532) Impala should tolerate bad locale settings.
[
https://issues.apache.org/jira/browse/IMPALA-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785090#comment-16785090
]
Tim Armstrong commented on IMPALA-532:
--
Simple repro. I think one variant of the issue might have been fixed where it
crashes on startup, but it's totally reproducible by running a query.
{noformat}
$ LC_ALL="bad lang" start-impala-cluster.py && impala-shell.sh -q "select
count(*) from functional.alltypes";
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (bad lang)
16:25:16 MainThread: Starting State Store logging to
/home/tarmstrong/Impala/incubator-impala/logs/cluster/statestored.INFO
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (bad lang)
16:25:17 MainThread: Starting Catalog Service logging to
/home/tarmstrong/Impala/incubator-impala/logs/cluster/catalogd.INFO
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (bad lang)
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (bad lang)
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (bad lang)
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (bad lang)
16:25:18 MainThread: Starting Impala Daemon logging to
/home/tarmstrong/Impala/incubator-impala/logs/cluster/impalad.INFO
16:25:18 MainThread: Starting Impala Daemon logging to
/home/tarmstrong/Impala/incubator-impala/logs/cluster/impalad_node1.INFO
16:25:18 MainThread: Starting Impala Daemon logging to
/home/tarmstrong/Impala/incubator-impala/logs/cluster/impalad_node2.INFO
16:25:21 MainThread: Found 3 impalad/1 statestored/1 catalogd process(es)
16:25:21 MainThread: Getting num_known_live_backends from tarmstrong-box:25000
16:25:21 MainThread: 'backends'
16:25:21 MainThread: Waiting for num_known_live_backends=3. Current value: None
16:25:22 MainThread: Getting num_known_live_backends from tarmstrong-box:25000
16:25:22 MainThread: Waiting for num_known_live_backends=3. Current value: 0
16:25:23 MainThread: Getting num_known_live_backends from tarmstrong-box:25000
16:25:23 MainThread: Waiting for num_known_live_backends=3. Current value: 0
16:25:24 MainThread: Getting num_known_live_backends from tarmstrong-box:25000
16:25:24 MainThread: Waiting for num_known_live_backends=3. Current value: 0
16:25:25 MainThread: Getting num_known_live_backends from tarmstrong-box:25000
16:25:25 MainThread: Waiting for num_known_live_backends=3. Current value: 0
16:25:26 MainThread: Getting num_known_live_backends from tarmstrong-box:25000
16:25:26 MainThread: num_known_live_backends has reached value: 3
16:25:27 MainThread: Getting num_known_live_backends from tarmstrong-box:25001
16:25:27 MainThread: num_known_live_backends has reached value: 3
16:25:27 MainThread: Getting num_known_live_backends from tarmstrong-box:25002
16:25:27 MainThread: num_known_live_backends has reached value: 3
16:25:28 MainThread: Impala Cluster Running with 3 nodes (3 coordinators, 3
executors).
Starting Impala Shell without Kerberos authentication
Opened TCP connection to localhost:21000
Connected to localhost:21000
Server version: impalad version 3.2.0-SNAPSHOT DEBUG (build
2e5c45fe20e74afc24e24999a31bddbfa6fdd4f7)
Query: select count(*) from functional.alltypes
Query submitted at: 2019-03-05 16:25:28 (Coordinator:
http://tarmstrong-box:25000)
Query progress can be monitored at:
http://tarmstrong-box:25000/query_plan?query_id=f74cdb69fbc45292:94becc4d
Socket error 104: Connection reset by peer
Could not execute command: select count(*) from functional.alltypes
{noformat}
> Impala should tolerate bad locale settings.
> ---
>
> Key: IMPALA-532
> URL: https://issues.apache.org/jira/browse/IMPALA-532
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
>Affects Versions: Impala 1.1
>Reporter: Ishaan Joshi
>Priority: Minor
>
> Currently, the Statestore does not tolerate a bad locale setting and crashes
> while starting up.
> {code}
> USE_DEBUG_BUILD=false
> + perl -pi -e
> 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/2469-impala-STATESTORE#g'
>
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/state_store_flags
> perl: warning: Setting locale failed.
> perl: warning: Please check that your locale settings:
> LANGUAGE = (unset),
> LC_ALL = (unset),
> LANG = "fr_FR.UTF-8"
> are supported and installed on your system.
> perl: warning: Falling back to the standard locale ("C").
> + '[' -f
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> ']'
> + chmod 600
> /var/run/cloudera-scm-agent/process/2469-impala-STATESTORE/impala-conf/.htpasswd
> + false
> + export
> IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + IMPALA_BIN=/opt/cloudera/parcels/IMPALA-1.1-1.p0.8/lib/impala/sbin-retail
> + '[' impalad = statestore ']'
> +
