Re: [Maria-developers] Implementation of Threadpool
[out of topic] i don't know if proxysql works with AIX, but maybe it's a workaround https://www.proxysql.com/ Em ter, 17 de set de 2019 às 09:13, GUESNET, ETIENNE (ext) < etienne.guesnet.exter...@atos.net> escreveu: > Hi, > > I am implementing a threadpool system to AIX. The AIX equivalent of epoll > / kqueue on AIX is pollset (and IOCP, but partial implementation only). > However, pollset has only a level-trigger mode and MariaDB needs > edge-trigger (see comments of sql/threadpoll_generic.h file). Adding a > pollset support in MariaDB would be difficult, and probably not so > efficient, as we need to simulate the edge-trigger behavior. > > Obviously, AIX has poll and select support. MariaDB has not. Is there a > reason to don’t implement threadpoll through poll or select? No interest? > Performance issues? > > MariaDB currently works on AIX without threadpool; in term of efficiency, > do you know what can be obtained using threadpool with poll/select or a > more modern solution? > > As far I know, SunOS/Solaris/Illumos threadpoll system (called “port”) is > also level-trigger only, but I do not find specific functions to manage > this. > > Thanks! > > Etienne Guesnet. > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Commits] test
noise ignored =) Em seg, 11 de mar de 2019 às 15:11, Faustin Lammler escreveu: > Hi, > this is a test, please do not respond. > > And sorry for the noise. > > -- > Faustin Lammler > MariaDB Foundation > ___ > commits mailing list > comm...@mariadb.org > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits -- Roberto Spadim SPAEmpresarial - Software ERP Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] an observation
hum... did you checked only linux version, or windows too? could you provide a SQL example? 2017-01-29 14:30 GMT-02:00 AugustQ : > Hi, > > by playing with the code I think I found something interesting. > > My environment: MariaDB 10.0.10, MyISAM-engine > > I played with a table-scan, no index is defined on this table. When I > execute a SQL-statement that forces the server to do a second table-scan on > a table this 2nd table-scan will be slow. > > The reason for this behaviour is the usage of a buffer: during the 1st scan > this buffer is filled, used and filled again until the whole table is > processed. At the end of the 1st scan it contains the last bytes of the > file. When a 2nd scan is started the reading of the table starts from the > beginning of the file but the buffer and all associated variables are not > reset: the buffer still contains the bytes from the end of the file, the > request cannot be fulfilled by the buffer so the request has to be handled > by reading the bytes directly from the file using the read()-function of > the Std-library. This takes much more time then simply copying the bytes > from the internal buffer. > > My idea is: somewhere in the code this situation must be detected and the > buffer (and all associated variables) reset to initial values. > reinit_io_cache() looks like the right candidate for this. > > I assume the engine Maria will show the same effect (I didn't check other > engines). > > Some questions: is my observation correct? Do you think this needs to be > fixed? Or is there no further development on this part of the code? > > Thanks > > Regards > AugustQ > > PS: you will find more details on this topic here: > http://augustq.blogspot.com/2017/01/subselect-execution-3.html > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial - Software ERP Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] aria engine crash at recovery
data partially recovered, procedure: aria_read_log -r --datadir=/home/mysql/data/local/ --require-control-file -e rastreabilidade --transaction-log --start-from-lsn=67 . ok aria_read_log -r --datadir=/home/mysql/data/local/ --require-control-file -e rastreabilidade --transaction-log --start-from-lsn=68 . ok aria_chk -r --datadir=/home/mysql/data/local/ --require-control-file -e --transaction-log mysql start segment fault (same problem: 2016-12-22 3:41:13 139878188566400 [Note] mysqld: Aria engine: starting recovery, recovered pages: 0% 3082852397% 0%161222 3:41:13 [ERROR] mysqld got signal 11 ;) rm aria_log.0067 mysql start segment fault (same problem: 2016-12-22 3:41:13 139878188566400 [Note] mysqld: Aria engine: starting recovery, recovered pages: 0% 3082852397% 0%161222 3:41:13 [ERROR] mysqld got signal 11 ;) rm aria_log.0068 mysql start OK, but some data was not ok (maybe data after checkpoint) i didn't understood why mysqld force a "aria_read_log" with --start-from-checkpoint and crashed, if you check this : recovered pages: 0% 3082852397% 0%Segmentation fault it have >100% values?!!?!? (3082852397%) !!should be nice a option at MY.CNF to FORCE aria_read_log with 'START_FROM_LSN' instead of 'start_from_checkpoint'!! should i get all this emails and send to JIRA issue tracker? ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] aria engine crash at recovery
# /opt/mariadb/mariadb-10.1.20-linux-x86_64/bin/aria_read_log --aria-log-dir-path=/home/mysql/data/local/ --apply --silent --start-from-checkpoint Starting from checkpoint (68,0x5802896) TRACE of the last aria_read_log /opt/mariadb/mariadb-10.1.20-linux-x86_64/bin/aria_read_log: Aria engine: starting recovery recovered pages: 0% 3082852397% 0%Segmentation fault ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] aria engine crash at recovery
# aria_read_log --aria-log-dir-path=/home/mysql/data/local/ --apply --silent --start-from-checkpoint Starting from checkpoint (68,0x5802896) TRACE of the last aria_read_log aria_read_log: Aria engine: starting recovery recovered pages: 0% 3082852397% 0%Segmentation fault 2016-12-22 4:19 GMT-02:00 Roberto Spadim : > information at crash > > > > 161222 2:52:15 [ERROR] mysqld got signal 11 ; > This could be because you hit a bug. It is also possible that this binary > or one of the libraries it was linked against is corrupt, improperly built, > or misconfigured. This error can also be caused by malfunctioning hardware. > > To report this bug, see http://kb.askmonty.org/en/reporting-bugs > > We will try our best to scrape up some info that will hopefully help > diagnose the problem, but since we have already crashed, > something is definitely wrong and this may fail. > > Server version: 10.1.5-MariaDB-log > key_buffer_size=629145600 > read_buffer_size=4194304 > max_used_connections=34 > max_threads=52 > thread_count=14 > It is possible that mysqld could use up to > key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = > 1041422 K bytes of memory > Hope that's ok; if not, decrease some variables in the equation. > > Thread pointer: 0x0x7f10b5d10008 > Attempting backtrace. You can use the following information to find out > where mysqld died. If you see no messages after this, something went > terribly wrong... > stack_bottom = 0x7f10ea1fae80 thread_stack 0x48000 > mysys/stacktrace.c:247(my_print_stacktrace)[0x7f10f241eb0b] > sql/signal_handler.cc:153(handle_fatal_signal)[0x7f10f1fb8db5] > /lib64/libpthread.so.0(+0x10d00)[0x7f10f0b4bd00] > sql/sql_plist.h:181(I_P_List_iterator)[0x7f10f1f6af03] > mysys/lf_hash.c:125(lfind)[0x7f10f24281a0] > sql/table_cache.cc:1084(tdc_iterate(THD*, char (*)(void*, void*), void*, > bool))[0x7f10f1f6c4e3] > sql/table_cache.cc:267(tc_add_table(THD*, TABLE*))[0x7f10f1f6c808] > sql/sql_base.cc:2572(open_table(THD*, TABLE_LIST*, Open_table_context*))[ > 0x7f10f1e01272] > sql/sql_base.cc:4016(open_and_process_table)[0x7f10f1e050c8] > sql/sql_base.cc:5184(open_and_lock_tables(THD*, DDL_options_st const&, > TABLE_LIST*, bool, unsigned int, Prelocking_strategy*))[0x7f10f1e05394] > sql/sql_insert.cc:719(mysql_insert(THD*, TABLE_LIST*, List&, > List >&, List&, List&, enum_duplicates, > bool))[0x7f10f1e2e56e] > sql/sql_parse.cc:3866(mysql_execute_command(THD*))[0x7f10f1e45d2c] > sql/sql_parse.cc:7173(mysql_parse)[0x7f10f1e4bc3d] > sql/sql_parse.cc:1470(dispatch_command(enum_server_command, THD*, char*, > unsigned int))[0x7f10f1e4e2a8] > sql/sql_parse.cc:1095(do_command(THD*))[0x7f10f1e4e83b] > sql/sql_connect.cc:1347(do_handle_one_connection(THD*))[0x7f10f1f115ef] > sql/sql_connect.cc:1260(handle_one_connection)[0x7f10f1f11747] > /lib64/libpthread.so.0(+0x7654)[0x7f10f0b42654] > /lib64/libc.so.6(clone+0x6d)[0x7f10f02667dd] > > Trying to get some variables. > Some pointers may be invalid and cause the dump to abort. > Query (0x7f10a85ba020): is an invalid pointer > Connection ID (thread ID): 35347 > Status: NOT_KILLED > > Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_ > union=on,index_merge_intersection=on,index_merge_ > sort_intersection=off,engine_condition_pushdown=off,index_ > condition_pushdown=on,derived_merge=on,derived_with_keys=on, > firstmatch=on,loosescan=on,materialization=on,in_to_ > exists=on,semijoin=on,partial_match_rowid_merge=on,partial_ > match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_ > based=off,mrr_sort_keys=off,outer_join_with_cache=on, > semijoin_with_cache=on,join_cache_incremental=on,join_ > cache_hashed=on,join_cache_bka=on,optimize_join_buffer_ > size=off,table_elimination=on,extended_keys=on,exists_to_in=on > > The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html > contains > information that should help you find out what is causing the crash. > 161222 02:52:16 mysqld_safe Number of processes running now: 0 > 161222 02:52:16 mysqld_safe mysqld restarted > 2016-12-22 2:52:16 140012144617344 [Warning] 'THREAD_CONCURRENCY' is > deprecated and will be removed in a future release. > 2016-12-22 2:52:16 140012144617344 [Note] /usr/mariadb/mariadb/bin//mysqld > (mysqld 10.1.5-MariaDB-log) starting as process 31925 ... > 2016-12-22 2:52:16 140012144617344 [Note] mysqld: Aria engine: starting > recovery > recovered pages: 0% 3082852397% 0%161222 2:52:16 [ERROR] mysqld got > signal 11 ; > This could be because you hit a bug. It is also possible that this binary > or one of the libraries it was linked against is corrupt, improperly built, > or misconfigured. This error can also be caused by malf
Re: [Maria-developers] aria engine crash at recovery
information at crash 161222 2:52:15 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.5-MariaDB-log key_buffer_size=629145600 read_buffer_size=4194304 max_used_connections=34 max_threads=52 thread_count=14 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1041422 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x7f10b5d10008 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f10ea1fae80 thread_stack 0x48000 mysys/stacktrace.c:247(my_print_stacktrace)[0x7f10f241eb0b] sql/signal_handler.cc:153(handle_fatal_signal)[0x7f10f1fb8db5] /lib64/libpthread.so.0(+0x10d00)[0x7f10f0b4bd00] sql/sql_plist.h:181(I_P_List_iterator)[0x7f10f1f6af03] mysys/lf_hash.c:125(lfind)[0x7f10f24281a0] sql/table_cache.cc:1084(tdc_iterate(THD*, char (*)(void*, void*), void*, bool))[0x7f10f1f6c4e3] sql/table_cache.cc:267(tc_add_table(THD*, TABLE*))[0x7f10f1f6c808] sql/sql_base.cc:2572(open_table(THD*, TABLE_LIST*, Open_table_context*))[0x7f10f1e01272] sql/sql_base.cc:4016(open_and_process_table)[0x7f10f1e050c8] sql/sql_base.cc:5184(open_and_lock_tables(THD*, DDL_options_st const&, TABLE_LIST*, bool, unsigned int, Prelocking_strategy*))[0x7f10f1e05394] sql/sql_insert.cc:719(mysql_insert(THD*, TABLE_LIST*, List&, List >&, List&, List&, enum_duplicates, bool))[0x7f10f1e2e56e] sql/sql_parse.cc:3866(mysql_execute_command(THD*))[0x7f10f1e45d2c] sql/sql_parse.cc:7173(mysql_parse)[0x7f10f1e4bc3d] sql/sql_parse.cc:1470(dispatch_command(enum_server_command, THD*, char*, unsigned int))[0x7f10f1e4e2a8] sql/sql_parse.cc:1095(do_command(THD*))[0x7f10f1e4e83b] sql/sql_connect.cc:1347(do_handle_one_connection(THD*))[0x7f10f1f115ef] sql/sql_connect.cc:1260(handle_one_connection)[0x7f10f1f11747] /lib64/libpthread.so.0(+0x7654)[0x7f10f0b42654] /lib64/libc.so.6(clone+0x6d)[0x7f10f02667dd] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f10a85ba020): is an invalid pointer Connection ID (thread ID): 35347 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 161222 02:52:16 mysqld_safe Number of processes running now: 0 161222 02:52:16 mysqld_safe mysqld restarted 2016-12-22 2:52:16 140012144617344 [Warning] 'THREAD_CONCURRENCY' is deprecated and will be removed in a future release. 2016-12-22 2:52:16 140012144617344 [Note] /usr/mariadb/mariadb/bin//mysqld (mysqld 10.1.5-MariaDB-log) starting as process 31925 ... 2016-12-22 2:52:16 140012144617344 [Note] mysqld: Aria engine: starting recovery recovered pages: 0% 3082852397% 0%161222 2:52:16 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] aria engine crash at recovery
hi guys i got a crash and aria engine don't startup, any help? 161222 03:41:13 mysqld_safe Starting mysqld daemon with databases from /home/mysql/data/local/ 2016-12-22 3:41:13 139878188566400 [Warning] 'THREAD_CONCURRENCY' is deprecated and will be removed in a future release. 2016-12-22 3:41:13 139878188566400 [Note] /usr/mariadb/mariadb/bin//mysqld (mysqld 10.1.5-MariaDB-log) starting as process 19217 ... 2016-12-22 3:41:13 139878188566400 [Note] mysqld: Aria engine: starting recovery recovered pages: 0% 3082852397% 0%161222 3:41:13 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.5-MariaDB-log key_buffer_size=629145600 read_buffer_size=4194304 max_used_connections=0 max_threads=52 thread_count=0 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1041422 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x0 thread_stack 0x48000 mysys/stacktrace.c:247(my_print_stacktrace)[0x7f37ee645b0b] sql/signal_handler.cc:153(handle_fatal_signal)[0x7f37ee1dfdb5] /lib64/libpthread.so.0(+0x10d00)[0x7f37ecd72d00] maria/ma_recovery.c:2142(exec_REDO_LOGREC_CLR_END)[0x7f37ee5683b7] maria/ma_recovery.c:588(display_and_apply_record)[0x7f37ee56985d] maria/ma_recovery.c:350(maria_apply_log)[0x7f37ee56d45c] maria/ma_recovery.c:242(maria_recovery_from_log)[0x7f37ee56df1e] maria/ha_maria.cc:3594(ha_maria_init)[0x7f37ee546c2d] sql/handler.cc:512(ha_initialize_handlerton(st_plugin_int*))[0x7f37ee1e2518] sql/sql_plugin.cc:1403(plugin_initialize)[0x7f37ee089e65] sql/sql_plugin.cc:1675(plugin_init(int*, char**, int))[0x7f37ee08add2] sql/mysqld.cc:5064(init_server_components)[0x7f37edfc37e8] sql/mysqld.cc:5659(mysqld_main(int, char**))[0x7f37edfc61ca] /lib64/libc.so.6(__libc_start_main+0xf0)[0x7f37ec3a79f0] /usr/mariadb/mariadb/bin//mysqld(+0x39dbad)[0x7f37edfbabad] ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Fixing Some Trivial Bugs
normally i send patch to jira mdev page if accepted someone merge with the main branch (normally sergey), any doubt/ideas are sent to jira page too, some important ideas/doubts i send mail to maria-developer or discuss list, or to others developers or sometime irc, normally good patchs are commited, or rewrite and merged 2015-08-20 22:04 GMT-03:00 Alangi Derick : > Hi, >I just found some trivial bugs on jira that i will be fixing for > the time being. Once i am done with each one, i will submit a patch or > push to my forked repo so it can be merged. > > My question is, after i fix the bugs, will they accepted, if yes i > should continue working on them thanks. I need a respond from the > development team. > > Regards > Alangi Derick Ndimnain > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial - Software ERP Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] crash - analyze table with histogram
hi dnaie, problem solved with elena at jira, thanks 2015-06-23 20:02 GMT-03:00 Daniel Black : > > > - On 24 Jun, 2015, at 1:33 AM, roberto robe...@spadim.com.br wrote: > > > Hi guys, i got a crash, could someone help? > > > > --- > > queries: > > set histogram_size=255,histogram_type=SINGLE_PREC_HB; > > ANALYZE TABLE 19_org.estoque_itens PERSISTENT FOR ALL; > > /* Erro SQL (2013): Lost connection to MySQL server during query */ > > > > If its anything like https://mariadb.atlassian.net/browse/MDEV-7362 it > will be a value in one of the rows in that table. > > Eliminate column by column until you find the one that caused it. > > Then find the row (or just include the whole column in the bug report). > > > > --- > > log: > > > > 150623 12:31:47 [ERROR] mysqld got signal 11 ; > > This could be because you hit a bug. It is also possible that this binary > > or one of the libraries it was linked against is corrupt, improperly > built, > > or misconfigured. This error can also be caused by malfunctioning > hardware. > > > > To report this bug, see http://kb.askmonty.org/en/reporting-bugs > > > > We will try our best to scrape up some info that will hopefully help > > diagnose the problem, but since we have already crashed, > > something is definitely wrong and this may fail. > > > > Server version: 10.0.20-MariaDB-log > > key_buffer_size=2097152000 > > read_buffer_size=6291456 > > max_used_connections=22 > > max_threads=92 > > thread_count=9 > > It is possible that mysqld could use up to > > key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = > > 3180295 K bytes of memory > > Hope that's ok; if not, decrease some variables in the equation. > > > > Thread pointer: 0x0x7f523b81c008 > > Attempting backtrace. You can use the following information to find out > > where mysqld died. If you see no messages after this, something went > > terribly wrong... > > stack_bottom = 0x4b1410a0 thread_stack 0x48000 > > mysys/stacktrace.c:247(my_print_stacktrace)[0xbcb2ee] > > sql/signal_handler.cc:153(handle_fatal_signal)[0x71fa8c] > > /lib/libpthread.so.0[0x7f52ccbe98f0] > > sql/field.h:703(Field::set_notnull(long long))[0x610c70] > > sql/sql_statistics.cc:533(Stat_table::update_stat())[0x60dd68] > > sql/sql_admin.cc:759(mysql_admin_table)[0x67adc1] > > sql/sql_admin.cc:1183(Sql_cmd_analyze_table::execute(THD*))[0x67c66c] > > sql/sql_parse.cc:5095(mysql_execute_command(THD*))[0x5986c2] > > sql/sql_parse.cc:6529(mysql_parse(THD*, char*, unsigned int, > > Parser_state*))[0x59fc86] > > sql/sql_parse.cc:1310(dispatch_command(enum_server_command, THD*, > > char*, unsigned int))[0x5a1bb7] > > sql/sql_parse.cc:999(do_command(THD*))[0x5a22f9] > > sql/sql_connect.cc:1378(do_handle_one_connection(THD*))[0x66c7d4] > > sql/sql_connect.cc:1295(handle_one_connection)[0x66c912] > > /lib/libpthread.so.0[0x7f52ccbe1fe7] > > /lib/libc.so.6(clone+0x6d)[0x7f52cbb822bd] > > > > Trying to get some variables. > > Some pointers may be invalid and cause the dump to abort. > > Query (0x7f5190884020): is an invalid pointer > > Connection ID (thread ID): 304 > > Status: NOT_KILLED > > > > Optimizer switch: > > > index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on > > > > The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html > contains > > information that should help you find out what is causing the crash. > > > > > > -- > > Roberto Spadim > > > > ___ > > Mailing list: https://launchpad.net/~maria-developers > > Post to : maria-developers@lists.launchpad.net > > Unsubscribe : https://launchpad.net/~maria-developers > > More help : https://help.launchpad.net/ListHelp > > -- > -- > Daniel Black, Engineer @ Open Query (http://openquery.com.au) > Remote expertise & maintenance for MySQL/MariaDB server environments. > -- Roberto Spadim SPAEmpresarial - Software ERP Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubt about query cache and write locks
hi guys, i'm with a doubt when i execute LOCK TABLE xxx WRITE any query at query cache could be executed without locking (waiting for table lock state) shouldn't the lock table invalidade the table query cache when using a write lock? -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] crash - analyze table with histogram
Hi guys, i got a crash, could someone help? --- queries: set histogram_size=255,histogram_type=SINGLE_PREC_HB; ANALYZE TABLE 19_org.estoque_itens PERSISTENT FOR ALL; /* Erro SQL (2013): Lost connection to MySQL server during query */ --- log: 150623 12:31:47 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.0.20-MariaDB-log key_buffer_size=2097152000 read_buffer_size=6291456 max_used_connections=22 max_threads=92 thread_count=9 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 3180295 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x7f523b81c008 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x4b1410a0 thread_stack 0x48000 mysys/stacktrace.c:247(my_print_stacktrace)[0xbcb2ee] sql/signal_handler.cc:153(handle_fatal_signal)[0x71fa8c] /lib/libpthread.so.0[0x7f52ccbe98f0] sql/field.h:703(Field::set_notnull(long long))[0x610c70] sql/sql_statistics.cc:533(Stat_table::update_stat())[0x60dd68] sql/sql_admin.cc:759(mysql_admin_table)[0x67adc1] sql/sql_admin.cc:1183(Sql_cmd_analyze_table::execute(THD*))[0x67c66c] sql/sql_parse.cc:5095(mysql_execute_command(THD*))[0x5986c2] sql/sql_parse.cc:6529(mysql_parse(THD*, char*, unsigned int, Parser_state*))[0x59fc86] sql/sql_parse.cc:1310(dispatch_command(enum_server_command, THD*, char*, unsigned int))[0x5a1bb7] sql/sql_parse.cc:999(do_command(THD*))[0x5a22f9] sql/sql_connect.cc:1378(do_handle_one_connection(THD*))[0x66c7d4] sql/sql_connect.cc:1295(handle_one_connection)[0x66c912] /lib/libpthread.so.0[0x7f52ccbe1fe7] /lib/libc.so.6(clone+0x6d)[0x7f52cbb822bd] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f5190884020): is an invalid pointer Connection ID (thread ID): 304 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] mariadb 10.1.5 crash
Hi sergey, i'm loggins querirss now to check when the crash occur I think it's not related with create/drop, vit since i don't have the log i cant provide some kind of 100% information just the log You can create the bug eithout problemns It's mariadb 10.1.5 glibc>2.14 The serve load was low i was testing only, near to 5 active connections, others was connections not running anything just connections waiting queries Em quinta-feira, 18 de junho de 2015, Sergey Vojtovich escreveu: > Hi Roberto, > > according to this trace server crashed while evicting an object from table > cache (happens when we run out of table_open_cache). Likely because > per-share > free tables list was broken. The rest is quite moot yet: e.g. it may (or > may > not) also involve table definition cache eviction. > > Will you report a bug or should I? A valuable information would be if this > load > involved DDL and admin statements at least. table_open_cache and > table_definition_cache values, number of active connections, number of > tables > participating in this load. > > Thanks, > Sergey > > On Wed, Jun 17, 2015 at 07:46:34PM -0300, Roberto Spadim wrote: > > hi guys, i was testing mariadb with test servers and i hit a crash > > could anyone check? server has 8GB of ram, i don't know what query is > > > > > > > > > > 2015-06-17 14:01:32 140497706510080 [Note] WSREP: Stop replication > > 2015-06-17 14:01:32 140497706510080 [Note] Event Scheduler: Purging the > > queue. 0 events > > 2015-06-17 14:01:32 140497706510080 [Note] > > /usr/mariadb/mariadb/bin//mysqld: Shutdown complete > > > > 150617 14:01:32 mysqld_safe mysqld from pid file > /home/mysql/pid/local.pid > > ended > > 150617 14:02:38 mysqld_safe Starting mysqld daemon with databases from > > /home/mysql/data/local/ > > 2015-06-17 14:02:38 140260849645440 [Warning] 'THREAD_CONCURRENCY' is > > deprecated and will be removed in a future release. > > 2015-06-17 14:02:38 140260849645440 [Note] > /usr/mariadb/mariadb/bin//mysqld > > (mysqld 10.1.5-MariaDB-log) starting as process 2321 ... > > 2015-06-17 14:02:38 140260849645440 [Note] Plugin 'InnoDB' is disabled. > > 2015-06-17 14:02:38 140260849645440 [Note] Plugin 'FEEDBACK' is disabled. > > 2015-06-17 14:02:38 140260849645440 [Note] Server socket created on IP: > > '::'. > > 2015-06-17 14:02:38 140260849645440 [Note] Event Scheduler: Loaded 0 > events > > 2015-06-17 14:02:38 140260849645440 [Note] WSREP: Read nil XID from > storage > > engines, skipping position init > > 2015-06-17 14:02:38 140260849645440 [Note] WSREP: wsrep_load(): loading > > provider library 'none' > > 2015-06-17 14:02:38 140260849645440 [Note] > > /usr/mariadb/mariadb/bin//mysqld: ready for connections. > > Version: '10.1.5-MariaDB-log' socket: '/tmp/mysql.BH.sock' port: 3307 > > MariaDB Server > > 150617 17:02:14 [ERROR] mysqld got signal 11 ; > > This could be because you hit a bug. It is also possible that this binary > > or one of the libraries it was linked against is corrupt, improperly > built, > > or misconfigured. This error can also be caused by malfunctioning > hardware. > > > > To report this bug, see http://kb.askmonty.org/en/reporting-bugs > > > > We will try our best to scrape up some info that will hopefully help > > diagnose the problem, but since we have already crashed, > > something is definitely wrong and this may fail. > > > > Server version: 10.1.5-MariaDB-log > > key_buffer_size=629145600 > > read_buffer_size=4194304 > > max_used_connections=23 > > max_threads=102 > > thread_count=16 > > It is possible that mysqld could use up to > > key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = > > 1452041 K bytes of memory > > Hope that's ok; if not, decrease some variables in the equation. > > > > Thread pointer: 0x0x7f90d0353008 > > Attempting backtrace. You can use the following information to find out > > where mysqld died. If you see no messages after this, something went > > terribly wrong... > > stack_bottom = 0x7f9103539e80 thread_stack 0x48000 > > mysys/stacktrace.c:247(my_print_stacktrace)[0x7f9106c50b0b] > > sql/signal_handler.cc:153(handle_fatal_signal)[0x7f91067eadb5] > > /lib64/libpthread.so.0(+0x10d00)[0x7f910537dd00] > > sql/sql_plist.h:181(I_P_List_iterator)[0x7f910679cf03] > > mysys/lf_hash.c:125(lfind)[0x7f9106c5a1a0] > > sql/table_cache.cc:1084(tdc_iterate(THD*, char (*)(void*, void*), void*, > > bool))[0x7f910679e4e3]
[Maria-developers] mariadb 10.1.5 crash
processes running now: 0 150617 17:02:14 mysqld_safe mysqld restarted 2015-06-17 17:02:15 140086665152384 [Warning] 'THREAD_CONCURRENCY' is deprecated and will be removed in a future release. 2015-06-17 17:02:15 140086665152384 [Note] /usr/mariadb/mariadb/bin//mysqld (mysqld 10.1.5-MariaDB-log) starting as process 9785 ... 2015-06-17 17:02:15 140086665152384 [Note] mysqld: Aria engine: starting recovery recovered pages: 0% 10% 21% 31% 41% 51% 78% 90% 100% (0.0 seconds); tables to flush: 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 (0.3 seconds); 2015-06-17 17:02:15 140086665152384 [Note] mysqld: Aria engine: recovery done 2015-06-17 17:02:15 140086665152384 [Note] Plugin 'InnoDB' is disabled. 2015-06-17 17:02:15 140086665152384 [Note] Plugin 'FEEDBACK' is disabled. 2015-06-17 17:02:15 140086665152384 [Note] Recovering after a crash using tc.log 2015-06-17 17:02:15 140086665152384 [Note] Starting crash recovery... 2015-06-17 17:02:15 140086665152384 [Note] Crash recovery finished. 2015-06-17 17:02:15 140086665152384 [Note] Server socket created on IP: '::'. 2015-06-17 17:02:15 140086665152384 [Note] Event Scheduler: Loaded 0 events 2015-06-17 17:02:15 140086665152384 [Note] WSREP: Read nil XID from storage engines, skipping position init 2015-06-17 17:02:15 140086665152384 [Note] WSREP: wsrep_load(): loading provider library 'none' 2015-06-17 17:02:15 140086665152384 [Note] /usr/mariadb/mariadb/bin//mysqld: ready for connections. Version: '10.1.5-MariaDB-log' socket: '/tmp/mysql.BH.sock' port: 3307 MariaDB Server 2015-06-17 17:02:19 140086617798400 [ERROR] mysqld: Table './conquista_comercial/est_atu' is marked as crashed and should be repaired 2015-06-17 17:02:19 140086617798400 [Warning] Checking table: './conquista_comercial/est_atu' 2015-06-17 17:02:19 140086617798400 [ERROR] mysqld: Table './conquista_comercial/est_spa' is marked as crashed and should be repaired 2015-06-17 17:02:19 140086617798400 [Warning] Checking table: './conquista_comercial/est_spa' 2015-06-17 17:02:51 140086617798400 [ERROR] mysqld: Table './conquista_comercial/est_dia' is marked as crashed and should be repaired 2015-06-17 17:02:51 140086617798400 [Warning] Checking table: './conquista_comercial/est_dia' 2015-06-17 17:02:52 140086617798400 [ERROR] mysqld: Table './conquista_comercial/rastreabilidade_impressao' is marked as crashed and should be repaired 2015-06-17 17:02:52 140086617798400 [Warning] Checking table: './conquista_comercial/rastreabilidade_impressao' 2015-06-17 17:29:58 140086663948032 [ERROR] mysqld: Table './conquista_comercial/est_atu_erros' is marked as crashed and should be repaired 2015-06-17 17:29:58 140086663948032 [Warning] Checking table: './conquista_comercial/est_atu_erros' 2015-06-17 19:24:04 140086538364672 [Note] /usr/mariadb/mariadb/bin//mysqld: Normal shutdown 2015-06-17 19:24:04 140086538364672 [Note] WSREP: Stop replication 2015-06-17 19:24:06 140086538364672 [Note] Event Scheduler: Purging the queue. 0 events 2015-06-17 19:24:07 140086538364672 [Note] /usr/mariadb/mariadb/bin//mysqld: Shutdown complete 150617 19:24:07 mysqld_safe mysqld from pid file /home/mysql/pid/local.pid ended -- Roberto Spadim SPAEmpresarial - Software ERP Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] storage engine index usage
well, i'm not a expert , and it's not comment about storage engine plugin, but i will give one example with information schema plugin, there's parameters to know what you could optimize with where clausule, maybe this can help: http://dev.mysql.com/doc/refman/5.7/en/writing-information-schema-plugins.html static int simple_fill_table(THD *thd, TABLE_LIST *tables, Item *cond) http://dev.mysql.com/tech-resources/articles/mysql_i_s_plugins_part2.html The TABLE_LIST *tables argument provides the handle to the information schema table that is being filled, and the COND *cond argument represents the WHERE condition of the SQL statement that is currently being handled, allowing the fill_table function to directly filter rows (instead of relying on the query execution engine to do that). As such, these arguments are occupied with the actual delivery of rows of data to the server. 2015-02-06 14:08 GMT-02:00 Andras Szabo : > Hi Folks, > > A new question has risen during the development of our storage engine. > > In short the engine is providing a read-only view to the server > filesystem. > > One can issue (implemented via assisted discovery): > > CREATE TABLE etc ENGINE=fsview ROOT=‘/etc’; > > Then it’s possible to tell: > > SELECT name, fsize FROM etc ORDER BY fsize DESC LIMIT 10 > > resulting in: > > +-++ > | name| fsize | > +-++ > | ld.so.cache | 129417 | > | mailcap | 44732 | > | fb.modes| 24501 | > | mime.types | 24066 | > | brltty.conf | 22478 | > | services| 19558 | > | devscripts.conf | 18037 | > | ltrace.conf | 14867 | > | login.defs | 10551 | > | sensors3.conf | 10344 | > +-++ > > So far so good (the listing is not recursive). > > An additional feature is to access subdirectories of the root (this is > working via automated discovery): > > SELECT name, fsize FROM `etc/init.d` > > This is not terribly wrong, but we’re thinking about the possiblity of > improving it somehow that: > > SELECT name, fsize FROM etc WHERE path = “init.d”; > > However we’re in a bit of trouble how we could improve the storage engine > to be able to handle this. > > Of course we would not like to do a "deep enumeration" of the root > directory (full table scan) . So somehow we would like to access/use the > information from the where clause. > > Can anybody recommend a way to solve that? > > > -- > Andras Szabo > Sent with Airmail > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial - Software ERP Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] crash, reporting bugs
i don't have problem with askmonty, i'm thinking about new users only, it's easier to a newbie see a url with mariadb and report some problem, instead of a 'never seen' domain, normaly users know about mariadb and go to mariadb.org or mariadb.com, askmonty isn't a 'standard' name to new users 2014-12-01 15:41 GMT-02:00 Sergei Golubchik : > Hi, Roberto! > > On Nov 24, Roberto Spadim wrote: > > hi guys, i have a consistent crash (mdev-7182) but this email is not > about > > it... > > > > when i got the crash, i got this info: > > ... > > > > To report this bug, see http://kb.askmonty.org/en/reporting-bugs > > ... > > > > should we update this url to the current one? > > > > > https://mariadb.com/kb/en/mariadb/development/debugging-mariadb/reporting-bugs/ > > Why? Old url still works. > And I feel like new one is too long for the error message > > Regards, > Sergei > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about read uncommited
Hi Jocelyn! 2014-11-25 5:27 GMT-02:00 jocelyn fournier : > Hi Jean, > > Read uncommited is definitly treated differently on TokuDB (no snapshot > read). You have a description of the kind of lock taken on TokuDB depending > on the isolation level here : > https://github.com/Tokutek/tokudb-engine/wiki/Transactions-and-Concurrency wow, a very nice wiki about isolation levels, should be nice this at mariadb kb, and maybe with innodb and others engines, just to better explain how it works, very nice wiki > Jocelyn > thanks Jocelyn! ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about read uncommited
esting query fixes > to the developer and if something is really bad and shouldn't be give devs > here details. > nice > > > 3) try other non standard mariadb engine? > > You could try tokudb the same way. > right, considering this too what about replication with toku? i didn't tested yet, is something different that i should pay attention? > > > 4) use faster storage to reduce write/read time, reducing lock time > > i think that's not a good solution, but the last one i have, with a high > > cost > > Lock time isn't related to storage. After fixing queries and indexes you > still might have a slow hardware problem. > > Sometimes good solutions aren't free. > yes > > > do you see any other solution to this problems? any other experience like > > this? > > Get details to identify the cause of the problems. > > New Relic can help breakdown web requests and information as to which DB > queries occur in them. Might still be useful with closed source > applications. > > > sorry i was reading the 'to' part of email, i selected the > maria-developers > > instead maria-discuss > > yes. > > > -- > -- > Daniel Black, Engineer @ Open Query (http://openquery.com.au) > Remote expertise & maintenance for MySQL/MariaDB server environments. > thanks Daniel -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about read uncommited
hi Daniel the problems: 1) i have a application/database design problem, i don't have access to source code, the application is running in a server, and database at other, i have only access to database 2) at database the problem is with myisam locking contention when running slow updated and selects, update get a write lock and select wait it, no problems with insert (yet), no deletes in this table (yet) i tried to partition this table, but this don't reduce the write lock time, the where part of update normally get rows from all partitions 3) users report long times waiting data (this happen with long updates, i confirm this with slow query log and processlist) what i'm thinking as possible solutions, but i don't know if it's really possible, or how complex it is 0) leave developer solve the problem rewriting code the 'best' one, but i need to contact he, i'm not finding he, trying to call, sending email and nothing... 1) convert myisam to innodb and check what happen i'm creating another server to reproduce the load, this take sometime (>100gb myisam tables) it's executing from the first email i will execute some logged queries to reproduce load, and check what problems i will have at query log there're queries without "where" part (possible slow queries to innodb) and queries using count/min/max without "where" too 2) try to improve or create a new lock method at storage engine (myisam or aria) to allow "dirty" read possible? sounds interesting? is relevant or usefull? i was reading jira about mvcc with aria, but it's from 2011, a bit old and no news 3) try other non standard mariadb engine? not sure if relevant, non standard engine = non standard problems, must discover new storages, but don't know where to start 4) use faster storage to reduce write/read time, reducing lock time i think that's not a good solution, but the last one i have, with a high cost --- do you see any other solution to this problems? any other experience like this? sorry i was reading the 'to' part of email, i selected the maria-developers instead maria-discuss ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about read uncommited
Hi jean! 2014-11-25 1:04 GMT-02:00 Jean Weisbuch : > Transaction level only has effect on transactional engines yeap :) i tested with non transactional just to confirm the "dumb doubt" > (and note that read uncommited is treated as read commited on TokuDB if i > recall correctly) hu maybe i read this from tokudb... i think you are right, thanks! > thus the variable has no effect on MyISAM and Aria. > yeap... but aria have a jornal file... maybe we could do something... i was searching jira and found a delete/update concurrent with aria (MDEV-23), maybe that's the 'solution' anyone know about this MDEV? > > Le 25/11/2014 03:48, Roberto Spadim a écrit : > >> hi guys, i use read uncommited sometimes with innodb, that's nice and work >> but now, i'm using a myisam table, and a aria table >> does read uncommited work with this kind of engine? i tested and table >> stay 'waiting table lock' while a long update occurs >> i don't know what's the internal diference but is possible to "easily" >> implement read uncommited to myisam/aria? >> > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about read uncommited
m/aria? > > It is possible to change to easily change to innodb i don't have the source code of app, probably i could execute a "proxy" between client and server to rewrite and implement begin/commit, and execute single statistics that myisam have (max/min/count) with triggers and statistics tables, rewrite some queries, etc... but this is a bit "complex", i don't know how complex it is yet, i didn't tested and didn't tried to convert a whole system without changing source code i know that i'm with a design problem, probably the 'easily' solution is contacting the developer , an actually transactional storage engine, for the transaction features > you want to use? > well... i don't know if this need all transactional features of innodb, i didn't checked yet if the row length could break innodb engine, and i should partition this table and create a view or a vertical partition table with spider i was thinking about ACID: * Atomicity - i don't need and myisam/aria don't have (aria "partially atomicity") * Consistency - no need... only unique keys check * Isolation - that's my doubt today myisam serialize writes that's a lock method, not a isolation method with read it do a 'uncommited' (execute reads with locks), it's a "lock oriented" engine what i'm thinking is write execute normally as myisam/aria do, only select with read uncommited could read while writing, others selects should wait table write lock as normal i don't know how complex, but maybe the simple solutions is a read that change writes to wait or something like this, i really don't know yet what's the solution, just trying to check if any idea could be possible this will increase some lock contention or anyother contention (or maybe reduce it)... anything better than long write lock is ok * Durability - execute as myisam/aria do today i think aria have better support to this since aria have jornal log and some kind of multi versioning aria write to jornal, and after write to file, the file have the 'uncommited data' and the jornal+file have the "commited" data what i'm thinking with aria: 1) when executing this selects (uncommited) we could ensure that jornal be write to file before starting select 2) writing from jornal to file is blocked 3) when select end, the write from jornal to file is released well i don't know if this is possible, just an idea... maybe no other engine do this in this way (non transactional), i didn't checked yet nosql storages/plugins solutions, any idea? sorry many doubts and questions, i'm thinking about possible solutions -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubt about read uncommited
hi guys, i use read uncommited sometimes with innodb, that's nice and work but now, i'm using a myisam table, and a aria table does read uncommited work with this kind of engine? i tested and table stay 'waiting table lock' while a long update occurs i don't know what's the internal diference but is possible to "easily" implement read uncommited to myisam/aria? -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] crash, reporting bugs
hi guys, i have a consistent crash (mdev-7182) but this email is not about it... when i got the crash, i got this info: ... To report this bug, see http://kb.askmonty.org/en/reporting-bugs ... should we update this url to the current one? https://mariadb.com/kb/en/mariadb/development/debugging-mariadb/reporting-bugs/ thanks -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] MariaDB 10.0.14 got rid of replication safety warning without warning in release notes?
hum didn't got the point here, what's the big problem? some replication could break if a replication with more than one unique key got "colision" or something like it? ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] Maybe a new information schema table for replication?
Hi guys, i got one question these days and i don't know how to solve... the question is: "How to see the queries executing by replication thread?" i'm thinking about a information schema plugin to see whats is 'queued' in replication thread, at "master" (write to binlog) and "slave" (executing from binlog) side any idea if this is possible? i didn't checked or read any part of binlog/replication code yet thanks guys! :) -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about mariadb dialog plugin at server and client side
hum strange at mysql command line ok i will test again heidisql, maybe i missed something i will check again i agree the "password, please" is part of plugin auth at server side, and only called by client side if i have the dialog plugin i will check again ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about mariadb dialog plugin at server and client side
even with mariadb-10.0.14 client it didn't work: $mysql --version mysql Ver 15.1 Distrib 10.0.14-MariaDB, for Linux (x86_64) using EditLine wrapper $mysql --plugin-dir=/home/rspadim/mariadb/mariadb-10.0.14/plugin/auth_dialog --user=test_dialog --host=spd1.spadim.com.br [mariadb] Password, please: Welcome to the MariaDB monitor. Commands end with ; or \g. Your MariaDB connection id is 49254 Server version: 10.0.14-MariaDB-log Source distribution Copyright (c) 2000, 2014, Oracle, SkySQL Ab and others. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. MariaDB [(none)]> ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubt about mariadb dialog plugin at server and client side
Hi guys I'm with a doubt at dialog plugin I created a user at mariadb server: ---SQL INSTALL PLUGIN three_attempts SONAME 'dialog_examples.so'; CREATE USER test_dialog IDENTIFIED VIA three_attempts USING 'SECRET'; FLUSH PRIVILEGES; --- now i'm trying to connect as user test_dialog: ---SHELL $mysql *--plugin-dir=/home/rspadim/mariadb/mariadb-10.0.14/plugin/auth_dialog* --user=test_dialog --host=spd1.spadim.com.br --password Enter password: (i just hit enter) [mariadb] Password, please: (enter again) [mariadb] Password, please: (SECRET enter) Welcome to the MariaDB monitor. Commands end with ; or \g. Your MariaDB connection id is 49243 Server version: 5.5.5-10.0.14-MariaDB-log Source distribution Copyright (c) 2000, 2012, Oracle, Monty Program Ab and others. Reading history-file /home/beto/.mysql_history Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. MariaDB [(none)]> quit Writing history-file /home/beto/.mysql_history --- ---SHELL $ls /home/rspadim/mariadb/mariadb-10.0.14/plugin/auth_dialog CMakeFiles cmake_install.cmake CMakeLists.txt CTestTestfile.cmake dialog.c *dialog.so* Makefile --- ---MYSQL.USER table || *Host* || *User* || *Password* || *Select_priv* || *Insert_priv* || *Update_priv* || *Delete_priv* || *Create_priv* || *Drop_priv* || *Reload_priv* || *Shutdown_priv* || *Process_priv* || *File_priv* || *Grant_priv* || *References_priv* || *Index_priv* || *Alter_priv* || *Show_db_priv* || *Super_priv* || *Create_tmp_table_priv* || *Lock_tables_priv* || *Execute_priv* || *Repl_slave_priv* || *Repl_client_priv* || *Create_view_priv* || *Show_view_priv* || *Create_routine_priv* || *Alter_routine_priv* || *Create_user_priv* || *Event_priv* || *Trigger_priv* || *Create_tablespace_priv* || *ssl_type* || *ssl_cipher* || *x509_issuer* || *x509_subject* || *max_questions* || *max_updates* || *max_connections* || *max_user_connections* || *plugin* || *auth_string* || || % || test_dialog || >>>CHECK NO PASSWORD!<<< || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || N || || || || || 0 || 0 || 0 || 0 || three_attempts || SECRET || --- the doubts: 1) why it accept my login with password? i *don't* have a password at mysql.user schema 2) why i didn't received a dialog like in heidisql? 3) there's a auth trace or auth verbose option at client side? or any other command to check if i loaded the dialog plugin? -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] review MDEV 6631
hi guys could review MDEV-6631? there's a pull request, maybe should include some test files, but I don't know how to implement profiler check with mysql test tools -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] help with auth plugins
Hi guys! :) i need some help... i got the auth_dialog and i'm including some features to implement otp (one time password) my question is... what ".h" file should i include to allow read/write from any_table from mysql schema? i checked some read/write from selftunning optimizer ( https://github.com/igniting/server/blob/3d101751d27215ccf88c6c9701ca113de4aabb4b/sql/opt_costmodel.cc#L273 ) but i didn't understand what should be included i'm getting messages like: In file included from /home/rspadim/mariadb/mariadb-10.1/server/sql/opt_range.h:36:0, from /home/rspadim/mariadb/mariadb-10.1/server/plugin/auth_otp/otp_auth.cc:26: --- my current source code (i don't know if .h order is ok): INCLUDES: #include "unireg.h" <- line 20 #include "sql_base.h" #include "lex.h" #include "sql_table.h" #include "sql_priv.h" #include "sql_class.h" #include "opt_range.h" <- line 26 #include "records.h" #include #include #include #include #include -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubts about show ___ any information table plugin
hi guys ! :) i was reading this: https://mariadb.com/kb/en/mariadb/development/mariadb-internals-documentation/information-schema-plugins-show-and-flush-statements/ and i'm with some doubts... automatically parser translate "_" to space? for example table A_B, i could use SHOW A B ? about the FLUSH what it does? any example of what it should do? like... i know we can reset some information counters, it's a 'shortcut' to avoid something like "SET pluginvariable=0"? if yes, maybe we could add some example at KB page, i'm with doubts, maybe a dba without knowledge about plugin internal will not understand thanks :) -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about MDL
humm it's something like a structure to handle locks and some features to deadlocks? i'm thinking about what it could help with "why one thread is locked/waiting lock with processlist information schema" instead of only 'waiting metadata table lock' know exactly what process/table have the lock, and how many locks it have ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about MDL
hummm, understook, it's something that include a deadlock too, now i'm understanding somethings more about mdl i didn't checked yet how the list of locks are handled to create some mdl informations, like what thread(s) is wait one specific mdl lock, for example a update (myisam/aria) running and a select waiting update or something like it ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Is it soon 'end of this year'?
And this one? https://nafiux.com/blog/2012/08/11/mysql-ldap-authentication-plugin/ 2014-10-13 12:37 GMT-03:00 Roberto Spadim : > is this one? > http://dev.mysql.com/doc/refman/5.5/en/cleartext-authentication-plugin.html > > 2014-10-13 12:21 GMT-03:00 Peter Laursen : > > I will ask here what we have. But it may never have been released,and it >> that case we not have it anymore (if not committed to version control). >> >> Including Georg Richter. Just in case if he remembers something. >> >> >> -- Peter >> >> On Mon, Oct 13, 2014 at 5:10 PM, Roberto Spadim >> wrote: >> >>> do you have the source of oracle plaintext auth plugin? i want read it >>> >>> 2014-10-13 12:09 GMT-03:00 Peter Laursen : >>> >>>> Well .. where will I find it documented how to use it with Oracle-MySQL >>>> configured for their LDAP authenticaton setup? The same code that worked >>>> with oracles API does not work with the MariaDB API. >>>> >>>> - Peter >>>> >>>> On Mon, Oct 13, 2014 at 5:04 PM, Sergei Golubchik >>>> wrote: >>>> >>>>> Hi, Peter! >>>>> >>>>> On Sep 17, Peter Laursen wrote: >>>>> > Around ˝ year ago I discussed with some people here (Sergei G and/or >>>>> Georg >>>>> > and/or Wlad) about support for Oracle-style plugins in the MariaDB >>>>> C-API. >>>>> > The plugins include >>>>> > >>>>> > 1 Windows authentication plugin >>>>> > 2) Clear text plugin. >>>>> > >>>>> > At that time I was told that it could be considered 'by end end of >>>>> this >>>>> > year'. >>>>> > >>>>> > 1) Windows authentication plugin. Not very important, but Sergei >>>>> told that >>>>> > he had been playing wiht it and it could probably be done in ~1 day. >>>>> >>>>> Yes. Unfortunately because of "not very important" part it gets >>>>> postponed over and over. >>>>> >>>>> > 2) This is used by Oracle for setting up LDAP.authentication. I am >>>>> very >>>>> > well aware that there is criticism of Oracle's implementation. But >>>>> this >>>>> > does not change the fact hat people use it with servers from Oracle >>>>> and >>>>> > expect clients to work with it. We get request(s) for it almost >>>>> every week. >>>>> > So this is most important (for us). >>>>> >>>>> What about clear text plugin? It is in 5.5 and in 10.0 and, as far as I >>>>> remember, always was there. Do you mean it doesn't work for you for >>>>> some >>>>> reason? >>>>> >>>>> Regards, >>>>> Sergei >>>>> >>>> >>>> >>>> ___ >>>> Mailing list: https://launchpad.net/~maria-developers >>>> Post to : maria-developers@lists.launchpad.net >>>> Unsubscribe : https://launchpad.net/~maria-developers >>>> More help : https://help.launchpad.net/ListHelp >>>> >>>> >>> >>> >>> -- >>> Roberto Spadim >>> SPAEmpresarial >>> Eng. Automação e Controle >>> >> >> > > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Is it soon 'end of this year'?
is this one? http://dev.mysql.com/doc/refman/5.5/en/cleartext-authentication-plugin.html 2014-10-13 12:21 GMT-03:00 Peter Laursen : > I will ask here what we have. But it may never have been released,and it > that case we not have it anymore (if not committed to version control). > > Including Georg Richter. Just in case if he remembers something. > > > -- Peter > > On Mon, Oct 13, 2014 at 5:10 PM, Roberto Spadim > wrote: > >> do you have the source of oracle plaintext auth plugin? i want read it >> >> 2014-10-13 12:09 GMT-03:00 Peter Laursen : >> >>> Well .. where will I find it documented how to use it with Oracle-MySQL >>> configured for their LDAP authenticaton setup? The same code that worked >>> with oracles API does not work with the MariaDB API. >>> >>> - Peter >>> >>> On Mon, Oct 13, 2014 at 5:04 PM, Sergei Golubchik >>> wrote: >>> >>>> Hi, Peter! >>>> >>>> On Sep 17, Peter Laursen wrote: >>>> > Around ˝ year ago I discussed with some people here (Sergei G and/or >>>> Georg >>>> > and/or Wlad) about support for Oracle-style plugins in the MariaDB >>>> C-API. >>>> > The plugins include >>>> > >>>> > 1 Windows authentication plugin >>>> > 2) Clear text plugin. >>>> > >>>> > At that time I was told that it could be considered 'by end end of >>>> this >>>> > year'. >>>> > >>>> > 1) Windows authentication plugin. Not very important, but Sergei told >>>> that >>>> > he had been playing wiht it and it could probably be done in ~1 day. >>>> >>>> Yes. Unfortunately because of "not very important" part it gets >>>> postponed over and over. >>>> >>>> > 2) This is used by Oracle for setting up LDAP.authentication. I am >>>> very >>>> > well aware that there is criticism of Oracle's implementation. But >>>> this >>>> > does not change the fact hat people use it with servers from Oracle >>>> and >>>> > expect clients to work with it. We get request(s) for it almost every >>>> week. >>>> > So this is most important (for us). >>>> >>>> What about clear text plugin? It is in 5.5 and in 10.0 and, as far as I >>>> remember, always was there. Do you mean it doesn't work for you for some >>>> reason? >>>> >>>> Regards, >>>> Sergei >>>> >>> >>> >>> ___ >>> Mailing list: https://launchpad.net/~maria-developers >>> Post to : maria-developers@lists.launchpad.net >>> Unsubscribe : https://launchpad.net/~maria-developers >>> More help : https://help.launchpad.net/ListHelp >>> >>> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Is it soon 'end of this year'?
do you have the source of oracle plaintext auth plugin? i want read it 2014-10-13 12:09 GMT-03:00 Peter Laursen : > Well .. where will I find it documented how to use it with Oracle-MySQL > configured for their LDAP authenticaton setup? The same code that worked > with oracles API does not work with the MariaDB API. > > - Peter > > On Mon, Oct 13, 2014 at 5:04 PM, Sergei Golubchik > wrote: > >> Hi, Peter! >> >> On Sep 17, Peter Laursen wrote: >> > Around ˝ year ago I discussed with some people here (Sergei G and/or >> Georg >> > and/or Wlad) about support for Oracle-style plugins in the MariaDB >> C-API. >> > The plugins include >> > >> > 1 Windows authentication plugin >> > 2) Clear text plugin. >> > >> > At that time I was told that it could be considered 'by end end of this >> > year'. >> > >> > 1) Windows authentication plugin. Not very important, but Sergei told >> that >> > he had been playing wiht it and it could probably be done in ~1 day. >> >> Yes. Unfortunately because of "not very important" part it gets >> postponed over and over. >> >> > 2) This is used by Oracle for setting up LDAP.authentication. I am very >> > well aware that there is criticism of Oracle's implementation. But this >> > does not change the fact hat people use it with servers from Oracle and >> > expect clients to work with it. We get request(s) for it almost every >> week. >> > So this is most important (for us). >> >> What about clear text plugin? It is in 5.5 and in 10.0 and, as far as I >> remember, always was there. Do you mean it doesn't work for you for some >> reason? >> >> Regards, >> Sergei >> > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubt about MDL
hi guys, i'm reading https://github.com/MariaDB/server/blob/10.1/sql/mdl.h i'm with a doubt... today we have the metadata lock plugin to check what mdl we have... my doubt is, how to expose how many threads are sharing the mdl key, and how many threads are waiting the mdl key, should it be possible or only one threrad could use one mdl? -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] Aria bug with query cache - wrong result and wrong table invalidation
Hi guys, could someone take a look at MDEV-6817? i'm testing a stress test with aria and row_format=page the problem is, running many php>while(1){ mysql>select max(column) from table; php> get the value, sum+1 mysql>insert into table (the value of column+1) php>} i got some problems... the value of the first max(column) sometimes return an old value in others words, the query isn't consistent, or the table invalidation code is wrong i got a value 296 at query cache if i change the autocommit from 1 to 0, i got a value of 297, i could use SQL_NO_CACHE and got the same 297 value the problem only occur with row_format=page -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC2014] Self-tuning cost coefficients
hi =] any news about self tune? 2014-08-20 13:41 GMT-03:00 Roberto Spadim : > very nice :) i didn't checked if the calculated values are being used at > optimizer, but i checked that lsqr is working now (with negative values) i > will execute some queries to check what change what is being saved at > optimizer_cost_factors table, etc > nice work :) > > > 2014-08-20 4:50 GMT-03:00 Anshu Avinash : > >> Hi all, >> >> I have written a documentation for framework which I have created for >> gathering and calculating cost coefficients for optimizer, as part of my >> GSoC project. It is available at >> http://igniting.in/gsoc2014/2014/08/20/documentation/. >> >> Any suggestions/reviews are welcome. >> >> Regards >> Anshu Avinash >> >> ___ >> Mailing list: https://launchpad.net/~maria-developers >> Post to : maria-developers@lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-developers >> More help : https://help.launchpad.net/ListHelp >> >> > > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] MariaDB 10.0.14 got rid of replication safety warning without warning in release notes?
*Committer:* Michael Widenius - *Date:* 2014-09-15 21:00:47 UTC - *mto:* This revision was merged to the branch mainline in revision 4402 <http://bazaar.launchpad.net/~maria-captains/maria/10.0/revision/4402>. - *Revision ID:* mo...@mariadb.org-20140915210047-prls1zl5gbs51hj2 Don't give warning if there are two unique keys used with INSERT .. ON DUPLICATE KEY UPDATE. We should assume that the store engine will report the first duplicate key for this case. >From what i understood, if there's two unique keys that have duplicate keys (insert values (1,1); insert values(1,1);) the first key will report the first warning, the second warning isn't a problem since the first one reported a duplicate key that's what i understood (but i'm not sure) mysql-test/suite/binlog/r/binlog_unsafe.result <http://bazaar.launchpad.net/~maria-captains/maria/10.0/revision/4400.1.3/mysql-test/suite/binlog/r/binlog_unsafe.result> removed this line from test cases: 2709 Warnings: 2710 Note1592Unsafe statement written to the binary log using statement format since BINLOG_FORMAT = STATEMENT. INSERT... ON DUPLICATE KEY UPDATE on a table with more than one UNIQUE KEY is unsafe sql/sql_base.cc <http://bazaar.launchpad.net/~maria-captains/maria/10.0/revision/4400.1.3/sql/sql_base.cc> included this line: 5307 #ifdef NOT_USED_IN_MARIADB AND SQL_CLASS.CC 6023 Auxiliary function to check if the warning for unsafe repliction statements 6024 should be thrown or suppressed. >From what i understood it's only to don't log many useless messages, and if a 'real' problem occur thrown an error instead of supress it Old code of suppression of unsafe logging error with LIMIT didn't work, because of wrong usage of my_interval_timer(). Suppress unsafe logging errors to the error log if we get too many unsafe logging errors in a short time. as expected at sql_class.cc This is to not overflow the error log with meaningless errors. - Each error code is suppressed and counted separately. - We do a 5 minute suppression of new errors if we get more than 10 errors in that time. Only print unsafe logging errors if log_warnings > 1. I don't know what's an unsafe log erro, should be nice an explain here 2014-09-26 13:38 GMT-03:00 Pavel Ivanov : > Hi, > > I see that in MariaDB 10.0.14 Michael disabled replication safety > warning for the case of INSERT ON DUPLICATE KEY UPDATE with several > unique keys with a comment "We should assume that the store engine > will report the first duplicate key for this case." > http://bazaar.launchpad.net/~maria-captains/maria/10.0/revision/4400.1.3 > What does that mean? Which key is "the first duplicate key" and why > MariaDB relies on an engine behavior which AFAIK is not guaranteed? > And why this serious change in behavior wasn't mentioned in the > Release Notes? > > On the related note Release Notes mention the error log flood > protection. Why it's not behind flag? How should I disable the feature > and get back to the old behavior? > > Thank you, > Pavel > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] BUG - MDEV 6781
Hi guys, i found a bug at query cache and sent a patch to solve it https://mariadb.atlassian.net/browse/MDEV-6781 https://github.com/rspadim/server/commit/5a5e47bf4141ebc3584ed365173dde87b70e23a9 there's a pull request at 10.1 github (that's only a line removing a +1 at database name length) please review the patch that was only found cause i'm using qc_info plugin from mdev-4682 thanks :) -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] OQGRAPH/others engine and query cache
Hi guys i was checking OQGRAPH limitations with query cache it can't use query cache cause we don't know when data base change, that's ok right? i think that's ok too some others engines have this 'problem' too the first answer is, since oqgraph can't know when data table changes, we can't cache oqgraph tables... i think that's right BUT... query cache 'save' table used in query cache, for example: select * from oq_graph this will include "select * from oq_graph" at query cache using table 'oq_graph' instead of only using 'oq_graph' we could include 'oq_graph' AND 'data_table' even when we 'only' use oq_graph at FROM part this is more interesting than turning query cache off to oq_graph, and this remove the problem of "the data table don't tell oqgraph when we need to invalidate query cache" and that's right! but since data_table changed it will invalidate all queries using it, including oq_graph queries =) check if i'm not wrong, i can try a patch with it if we don't have others query cache related problems (for example query cache don't support tables outside query) -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
=] nice, i will try soon 2014-09-23 15:50 GMT-03:00 Elmar Eperiesi-Beck : > Hi there, > we just managed to get the problems solved much faster as assumed. Thanks > to the community! > > Perhaps it makes sense to have just one crypto implementation to do not > confuse users. > You can find our Source Code under: https://github.com/eperi-GmbH/server > . As fork of the actual 10.1 Code base. > > By end of this week we will finish the tests for the encrypted external > key file and some other features and update the project. > Please keep in mind, that you have to use the MariaDB Configfile. Please > use the mode „innodb_file_per_table“ on the storage engine XtraDB. > > To create an encrypt table you can use: > create table a (value varchar(100)) PAGE_ENCRYPTION=1 > PAGE_ENCRYPTION_KEY=255; > > For the encryption we use aes-128 cvc - until end of this week, it is a > fixed key to make testing easier. > > If you want to have page compression enabled also, you can use: > create table b (value varchar(100)) PAGE_ENCRYPTION=1 > PAGE_ENCRYPTION_KEY=255 PAGE_COMPRESSED=1; > > Example Configuration: > [mysqld] > innodb_file_per_table > innodb_file_format=Barracuda > > Have fun with this implementation and feel free to play with it! > We are looking forward to your comments. > > Am 23.09.2014 um 12:26 schrieb Jonas Oreland : > > > Hi there, > > > > our implementation is in production :) > > but has not yet been open sourced due to other tasks consuming time :( > > > > it has solved all problems enumerated above...and I think it would be > much better to have one crypt implementation than two! > > i'll ask the pavel that does the open-sourcing for more info about what > is the current state. > > > > /Jonas > > > > > > On Fri, Sep 19, 2014 at 12:31 AM, Elmar Eperiesi-Beck < > el...@eperiesi-beck.de> wrote: > > Of course - we are working with high pressure on this topic. > > Unfortunately, we had more problems than expected to get the code up and > running - BUT we made it! > > > > Currently we have managed to implement a primitive xor encryption on the > page level. We have solved some issues with checksums mainly by > deactivating checksum validation for encrypted pages. This is still work in > progress. We would rather want to recalculate checksums instead of > deactivating them. > > > > We are now working on aes_cbc encryption. Problem with blockcyphers in > general ist hat the cypher text can be larger than the plaintext. This > means that the encrypted data will not fit into the default page size of > 16k (4k or 8k). This has to do with aes_cbc padding, which rounds up the > size to a divisor of the aes blocksize and in addition to that we need to > store key id and iv for the encrypted page and we need to remember the > original values of the non encrypted page. > > > > Currently we are using the FLUSH LSN field of the page header (Bytes > 26-33) and the old_style checksum (bytes 16376 – 16379) to store some of > our data. We are not quite sure if it is a good idea to reuse these fields. > Maybe the community can help with this question. > > > > We were also thinking about extending the original page header of 38 > Bytes by a crypto header. From our understanding it should be possible to > extend the header by X bytes whenever it is a crypto pagetype, leaving less > space for payload in that page. We do not yet know how to accomlish this > and if it is a good idea to do so. We might create more problems with > extending a header than we solve with it. From what we understand from page > compression, extending a header seems to be non trivial. > > > > We are always open to ideas of how to overcome these page size problems > and are willing to try different routes. > > > > So to sum it up - we think, that we are able to submit a first > implementation by beginning of october. > > > > > > ___ > > Mailing list: https://launchpad.net/~maria-developers > > Post to : maria-developers@lists.launchpad.net > > Unsubscribe : https://launchpad.net/~maria-developers > > More help : https://help.launchpad.net/ListHelp > > > > > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] MDEV-4682
Hi guy :) thanks for answering so fast! there's others two mdev too that i sent some patchs 1) mdev-6766 some status variables counters, and two variables to 'tune' try_lock of query cache, query_cache_write_timeout and query_cache_read_timeout, the today value is hard coded to 50ms, some benchmarks shows that the 'default' value could be lower, well just a tune parameter as many others based in time could be changed to different workloads 2) mdev-6631 (only check query cache quereis that use SQL_CACHE when query_cache_type=DEMAND i don't know if should be nice to include a DEMAND_NO_PRUNE, when old queries are included at query cache using query_cache_type=ON and after that switch to query_cache_type=DEMAND could block query cache from fetching old queries that are inside query cache, any way, i see the solution very nice, only queries that MUST be cached are cached and only queries with SQL_CACHE are seek inside query cache, this reduce a lot lock contention while searching and writing to query cache both at github others ideas are about changing query cache and lock use, maybe should be part of a rewriting the query cache code i use aria/myisam/innodb, when using aria/myisam i take advantage from insert concurrency, in other words i could execute concurrent insert and select queries, i think that this could be used at query cache, i don't know what exactly should be changed but could be nice a lockfree include of result blocks while the query information block stay as 'writing' status, and after all blocks write change it to 'done' status, just an idea (i don't knwo if this coudl work), other idea could be batch inserts like group commit, and the last one is dynamic block size (i think we have a mdev for this were i told to try use of SQL_SMALL_RESULT and SQL_BIG_RESULT or LIMIT) i think that's all thanks =] ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
Very good news Em terça-feira, 23 de setembro de 2014, Jonas Oreland escreveu: > Hi there, > > our implementation is in production :) > but has not yet been open sourced due to other tasks consuming time :( > > it has solved all problems enumerated above...and I think it would be much > better to have one crypt implementation than two! > i'll ask the pavel that does the open-sourcing for more info about what is > the current state. > > /Jonas > > > On Fri, Sep 19, 2014 at 12:31 AM, Elmar Eperiesi-Beck < > el...@eperiesi-beck.de > > wrote: > >> Of course - we are working with high pressure on this topic. >> Unfortunately, we had more problems than expected to get the code up and >> running - BUT we made it! >> >> Currently we have managed to implement a primitive xor encryption on the >> page level. We have solved some issues with checksums mainly by >> deactivating checksum validation for encrypted pages. This is still work in >> progress. We would rather want to recalculate checksums instead of >> deactivating them. >> >> We are now working on aes_cbc encryption. Problem with blockcyphers in >> general ist hat the cypher text can be larger than the plaintext. This >> means that the encrypted data will not fit into the default page size of >> 16k (4k or 8k). This has to do with aes_cbc padding, which rounds up the >> size to a divisor of the aes blocksize and in addition to that we need to >> store key id and iv for the encrypted page and we need to remember the >> original values of the non encrypted page. >> >> Currently we are using the FLUSH LSN field of the page header (Bytes >> 26-33) and the old_style checksum (bytes 16376 – 16379) to store some of >> our data. We are not quite sure if it is a good idea to reuse these fields. >> Maybe the community can help with this question. >> >> We were also thinking about extending the original page header of 38 >> Bytes by a crypto header. From our understanding it should be possible to >> extend the header by X bytes whenever it is a crypto pagetype, leaving less >> space for payload in that page. We do not yet know how to accomlish this >> and if it is a good idea to do so. We might create more problems with >> extending a header than we solve with it. From what we understand from page >> compression, extending a header seems to be non trivial. >> We are always open to ideas of how to overcome these page size problems >> and are willing to try different routes. >> >> So to sum it up - we think, that we are able to submit a first >> implementation by beginning of october. >> >> >> _______ >> Mailing list: https://launchpad.net/~maria-developers >> Post to : maria-developers@lists.launchpad.net >> >> Unsubscribe : https://launchpad.net/~maria-developers >> More help : https://help.launchpad.net/ListHelp >> >> > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] MDEV-4682
Hi guys, could check MDEV-4682? it's done to review thanks -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] Close some MDEV
Hi guys, could close these mdev: 1)MDEV-4599 (it will be implemented at mdev-4584) 2)MDEV-4581 (it will be implemented at mdev-4682) Please check this mdev-4682 too, i sent a patch via github, there's an option that should be implemented at compile time to turn stats on/off i didn't checked how to implement it yet, if anyone could help me :) it must set a macro #define QUERY_CACHE_QC_INFO_PLUGIN 1 at "configure" time, maybe via cmake gui or something like it maybe i should change QUERY_CACHE_QC_INFO_PLUGIN to QUERY_CACHE_INCLUDE_STATS to easier understand of macro definitions, help is wellcome here -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Switching on use of components in Jira
please include a new compenent Optimizer/Parser 2014-09-22 10:04 GMT-03:00 Rasmus Johansson : > Hello all, > > I will later today switch on the usage of Components in Jira. > Components are a way of grouping issues inside a project. The idea is > to map every issue in Jira, being it a bug or a new feature to a > component which describes to what area of MariaDB the issue belongs. > For example a bug in Aria would be marked with the component "Storage > Engine - Aria". Currently there are 37 components defined in Jira that > should cover many areas, but I'm sure there are a few missing. There > is one generic to which you can assign issues that doesn't fall into > any other category, called OTHER. I'll include the list of components > here in the end of this email. > > * What do you need to do? * > The Component field will be a mandatory field when closing an issue. > Therefore if a component (or several components) haven't been > specified earlier for an issue, you'll have to choose at least one > when closing an issue. The field has autocompletion so if you start > typing for example "Galera" you'll be presented with the alternatives > "Galera", "Galera Arbitrator garbd", and "Galera SST". If you don't > find a suitable component then choose the component called "OTHER". > > * What is the benefit of using components? * > It's a way of organizing issues inside a project, so that you easily > can pull out all issues related to a certain area of MariaDB, e.g. if > I wanted to know all bug fixes for replication I would click on the > Replication component and get a list. There is the possibility to set > up automatic assignees based on components and components can be used > in filters and reports throughout Jira. > > I hope this won't be a burden. All feedback is of course welcome. > > BR, > Rasmus > > * Components in the MariaDB Server project in JIRA * > Data Definition - Alter Table > Data Definition - Procedure > Data Definition - Temporary > Data Manipulation - Insert Delayed > Data Manipulation - Subquery > Dynamic Columns > Events > Full-text Search > Galera > Galera Arbitrator garbd > Galera SST > GIS > Locale Settings > OTHER > Platform Debian > Platform FreeBSD > Platform Power > Platform Windows > Plugin - Audit > Plugins > Query Cache > Replication > Show Profile > sql_error_log > SSL > Storage Engine - Aria > Storage Engine - Cassandra > Storage Engine - Connect > Storage Engine - InnoDB > Storage Engine - OQGRAPH > Storage Engine - Spider > Storage Engine - XtraDB > Storage Enging - TokuDB > Time zones > Triggers > Views > XML Functions > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Switching on use of components in Jira
a example of MDEV using Optimizer: https://mariadb.atlassian.net/browse/MDEV-6696 2014-09-22 14:51 GMT-03:00 Roberto Spadim : > please include a new compenent > Optimizer/Parser > > 2014-09-22 10:04 GMT-03:00 Rasmus Johansson : > > Hello all, >> >> I will later today switch on the usage of Components in Jira. >> Components are a way of grouping issues inside a project. The idea is >> to map every issue in Jira, being it a bug or a new feature to a >> component which describes to what area of MariaDB the issue belongs. >> For example a bug in Aria would be marked with the component "Storage >> Engine - Aria". Currently there are 37 components defined in Jira that >> should cover many areas, but I'm sure there are a few missing. There >> is one generic to which you can assign issues that doesn't fall into >> any other category, called OTHER. I'll include the list of components >> here in the end of this email. >> >> * What do you need to do? * >> The Component field will be a mandatory field when closing an issue. >> Therefore if a component (or several components) haven't been >> specified earlier for an issue, you'll have to choose at least one >> when closing an issue. The field has autocompletion so if you start >> typing for example "Galera" you'll be presented with the alternatives >> "Galera", "Galera Arbitrator garbd", and "Galera SST". If you don't >> find a suitable component then choose the component called "OTHER". >> >> * What is the benefit of using components? * >> It's a way of organizing issues inside a project, so that you easily >> can pull out all issues related to a certain area of MariaDB, e.g. if >> I wanted to know all bug fixes for replication I would click on the >> Replication component and get a list. There is the possibility to set >> up automatic assignees based on components and components can be used >> in filters and reports throughout Jira. >> >> I hope this won't be a burden. All feedback is of course welcome. >> >> BR, >> Rasmus >> >> * Components in the MariaDB Server project in JIRA * >> Data Definition - Alter Table >> Data Definition - Procedure >> Data Definition - Temporary >> Data Manipulation - Insert Delayed >> Data Manipulation - Subquery >> Dynamic Columns >> Events >> Full-text Search >> Galera >> Galera Arbitrator garbd >> Galera SST >> GIS >> Locale Settings >> OTHER >> Platform Debian >> Platform FreeBSD >> Platform Power >> Platform Windows >> Plugin - Audit >> Plugins >> Query Cache >> Replication >> Show Profile >> sql_error_log >> SSL >> Storage Engine - Aria >> Storage Engine - Cassandra >> Storage Engine - Connect >> Storage Engine - InnoDB >> Storage Engine - OQGRAPH >> Storage Engine - Spider >> Storage Engine - XtraDB >> Storage Enging - TokuDB >> Time zones >> Triggers >> Views >> XML Functions >> >> ___ >> Mailing list: https://launchpad.net/~maria-developers >> Post to : maria-developers@lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-developers >> More help : https://help.launchpad.net/ListHelp >> > > > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] MDEV-4682 revision
hi guys, i sent some patch about qc_info plugin ( https://mariadb.atlassian.net/browse/MDEV-4682), via pull request at github (https://github.com/MariaDB/server/pull/6), could anyone check if it's ok? i included test file changes there's only one thing todo, that's include/not include statistics inside query cache, since it increase memory use, i think could be nice at runtime change this variable and include statistics on/off (more info inside mdev) -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] doubt about tests files
sorry my fault, looking at the wrong directory 2014-09-19 23:30 GMT-03:00 Roberto Spadim : > hi guys! > i git cloned the last verison of mariadb from github, but i didn't found > test files > is it outside mariadb github source? > > -- > Roberto Spadim > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubt about tests files
hi guys! i git cloned the last verison of mariadb from github, but i didn't found test files is it outside mariadb github source? -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Commits] c8496e4: %B
working =P 2014-09-19 18:04 GMT-03:00 Igor Babaev : > revision-id: c8496e48c4b7c35e9702f98daa19cdb4ef190097 > parent(s): 0486b3b796ad7ec597bff775da248096731c58d5 > committer: Igor Babaev > branch nick: 10.1-test-commit > timestamp: 2014-09-19 13:47:43 -0700 > message: > > %B > --- > sql/opt_range.cc |2 ++ > 1 files changed, 2 insertions(+), 0 deletions(-) > > diff --git a/sql/opt_range.cc b/sql/opt_range.cc > index 27e20c0..c35bde6 100644 > --- a/sql/opt_range.cc > +++ b/sql/opt_range.cc > @@ -14,6 +14,8 @@ > along with this program; if not, write to the Free Software > Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 > USA */ > // test commit in git > +test 2 > + > /* >TODO: >Fix that MAYBE_KEY are stored in the tree so that we can detect use > ___ > commits mailing list > comm...@mariadb.org > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
very nice, good work :) 2014-09-19 10:17 GMT-03:00 Elmar Eperiesi-Beck : > We work with XtraDB in the first run and will extend it to others later on. > > Am 19.09.2014 um 15:04 schrieb Roberto Spadim : > > Very nice :) working only with innodb or any engine? > > Em quinta-feira, 18 de setembro de 2014, Elmar Eperiesi-Beck < > el...@eperiesi-beck.de> escreveu: > >> Of course - we are working with high pressure on this topic. >> Unfortunately, we had more problems than expected to get the code up and >> running - BUT we made it! >> >> Currently we have managed to implement a primitive xor encryption on the >> page level. We have solved some issues with checksums mainly by >> deactivating checksum validation for encrypted pages. This is still work in >> progress. We would rather want to recalculate checksums instead of >> deactivating them. >> >> We are now working on aes_cbc encryption. Problem with blockcyphers in >> general ist hat the cypher text can be larger than the plaintext. This >> means that the encrypted data will not fit into the default page size of >> 16k (4k or 8k). This has to do with aes_cbc padding, which rounds up the >> size to a divisor of the aes blocksize and in addition to that we need to >> store key id and iv for the encrypted page and we need to remember the >> original values of the non encrypted page. >> >> Currently we are using the FLUSH LSN field of the page header (Bytes >> 26-33) and the old_style checksum (bytes 16376 – 16379) to store some of >> our data. We are not quite sure if it is a good idea to reuse these fields. >> Maybe the community can help with this question. >> >> We were also thinking about extending the original page header of 38 >> Bytes by a crypto header. From our understanding it should be possible to >> extend the header by X bytes whenever it is a crypto pagetype, leaving less >> space for payload in that page. We do not yet know how to accomlish this >> and if it is a good idea to do so. We might create more problems with >> extending a header than we solve with it. From what we understand from page >> compression, extending a header seems to be non trivial. >> We are always open to ideas of how to overcome these page size problems >> and are willing to try different routes. >> >> So to sum it up - we think, that we are able to submit a first >> implementation by beginning of october. >> >> > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
Very nice :) working only with innodb or any engine? Em quinta-feira, 18 de setembro de 2014, Elmar Eperiesi-Beck < el...@eperiesi-beck.de> escreveu: > Of course - we are working with high pressure on this topic. > Unfortunately, we had more problems than expected to get the code up and > running - BUT we made it! > > Currently we have managed to implement a primitive xor encryption on the > page level. We have solved some issues with checksums mainly by > deactivating checksum validation for encrypted pages. This is still work in > progress. We would rather want to recalculate checksums instead of > deactivating them. > > We are now working on aes_cbc encryption. Problem with blockcyphers in > general ist hat the cypher text can be larger than the plaintext. This > means that the encrypted data will not fit into the default page size of > 16k (4k or 8k). This has to do with aes_cbc padding, which rounds up the > size to a divisor of the aes blocksize and in addition to that we need to > store key id and iv for the encrypted page and we need to remember the > original values of the non encrypted page. > > Currently we are using the FLUSH LSN field of the page header (Bytes > 26-33) and the old_style checksum (bytes 16376 – 16379) to store some of > our data. We are not quite sure if it is a good idea to reuse these fields. > Maybe the community can help with this question. > > We were also thinking about extending the original page header of 38 Bytes > by a crypto header. From our understanding it should be possible to extend > the header by X bytes whenever it is a crypto pagetype, leaving less space > for payload in that page. We do not yet know how to accomlish this and if > it is a good idea to do so. We might create more problems with extending a > header than we solve with it. From what we understand from page > compression, extending a header seems to be non trivial. > We are always open to ideas of how to overcome these page size problems > and are willing to try different routes. > > So to sum it up - we think, that we are able to submit a first > implementation by beginning of october. > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
=] any news? 2014-06-20 13:47 GMT-03:00 Roberto Spadim : > :) very nice > I will wait :) > > Em sexta-feira, 20 de junho de 2014, Elmar Eperiesi-Beck < > el...@eperiesi-beck.de> escreveu: > > 1) thats a good point, we will extend our coding to mysql_connect >> >> 2) yes, we want to do this with an INSERT statement - a bit more complex, >> but yes…. >> >> We will update the concept paper and come back to you beginning of next >> week. >> >> >> Am 20.06.2014 um 16:28 schrieb Roberto Spadim : >> >> > nice, check what i'm thinking about... >> > 1) >> > i start mariadb without keys >> > i start my app >> > here i must check that all tables are 'unlocked' and read to use, >> > we will have a method to this? at mysql_connect i will check if keys >> > are loaded, maybe a SHOW STATUS like 'encryption_keys_loaded' = 1 or 0 >> > >> > 2) >> > about externall acess to include encryption/key >> > maybe a sql statment? >> > INSERT INTO mysql.encrypt_keys (key,value) value (1,"abcdefg.") >> > >> > just an idea about external key uploading >> > or an external server (no problem) >> > >> > >> > >> > >> > >> > 2014-06-20 9:51 GMT-03:00 Elmar Eperiesi-Beck : >> >> At startup the keys will be read once and kept in memory. Normaly you >> are >> >> not going to encrypt 1000 tables, because you just encrypt the content >> that >> >> is confidential. But yes- each key has to be in the memory. Or you use >> an >> >> external encryption/key server that handels the encryption and the >> >> key-management outside the DB. >> >> >> >> We enhanced the concept, that it is possible to deliver the key >> manually at >> >> server startup. You can have it e.g. on a pendrive and start the >> server with >> >> the keys as a backup. >> >> >> >> >> >> >> >> Am 17.06.2014 um 18:55 schrieb Roberto Spadim : >> >> >> >> humm, now i'm thinking as a data warehouse >> >> think about installing a server (server 1) in somewhere (maybe saara >> >> desert) i connect the "server 1" to internet, and configure the >> server >> >> uri to point to my central server (server central), maybe at moon >> >> >> >> when the mysqld/mariadbd start, it will contact the central server and >> get >> >> all keys, or only get keys when i need? for example a server with 1000 >> >> tables and 1000 diferent keys, they are all stored at memory at boot >> time, >> >> or only when i need read/write access to that table? >> >> >> >> if i remove the internet link, the "server 1" will not read tables, >> right? >> >> in this case, if i have the keyfile in a pendrive, or a cd or dvd, >> could i >> >> redirect it to a key file and start database, as a backup solution? >> >> >> >> >> >> >> > >> > >> > >> > -- >> > Roberto Spadim >> > SPAEmpresarial >> > Eng. Automação e Controle >> >> > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] no information about references - mysql bug 73757
ok https://mariadb.atlassian.net/browse/MDEV-6697 done :) 2014-09-04 13:45 GMT-03:00 Sergei Golubchik : > Hi, Roberto! > > On Aug 29, Roberto Spadim wrote: > > Hi guys, there's a bug report about no precise information to solve a > problem: > > > > http://bugs.mysql.com/bug.php?id=73757 > > > > test case: > > > > create table t11 (f1 integer primary key) engine innodb; > > alter table t11 add constraint c1 foreign key (f1) references t1(f1); > > > > /* Erro SQL (1005): Can't create table `teste`.`#sql-3f90_25c30` > > (errno: 150 "Foreign key constraint is incorrectly formed") */ > > > > should be better explain that reference table t1 don't exists or > > something like it > > > > should i report at jira, or just mysql bug database is ok? > > Better report it in Jira too, it guarantees that we will have the fix > when we merge. > > Regards, > Sergei > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] doubt about mdev 4682 - tests
Guys, i'm with time and was looking an old patch about query cache information schema https://mariadb.atlassian.net/browse/MDEV-4682 it add an statistic about query cache hits my doubt is... i was trying to understand how could i create tests, since the result of statistic isn't deterministic how should i execute a test case like this? columns that i have doubt: columns ... QUERY_ROWS <- deterministic SELECT_ROWS_READ <- deterministic QUERY_HITS <- deterministic QUERY_HITS_PERIOD_LOW <- non deterministic QUERY_HITS_PERIOD_HIGH <- non deterministic QUERY_HITS_PERIOD_OUTLIERS <- non deterministic QUERY_HITS_TOTAL_TIME_US <- non deterministic QUERY_HITS_MEAN_PERIOD_US <- non deterministic QUERY_HITS_MEAN_PERIOD_LOW_US <- non deterministic QUERY_HITS_MEAN_PERIOD_HIGH_US <- non deterministic QUERY_INSERT_TIME <- probably deterministic (or not?) QUERY_LAST_HIT_TIME <- probably deterministic (or not?) SELECT_EXPEND_TIME_US <- non deterministic SELECT_LOCK_TIME_US <- non deterministic ... -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Interest in contributing to MariaDB
java? no guy, mariadb database source code is C/C++ check : github : https://github.com/MariaDB/server and issue tracker: https://mariadb.atlassian.net there's mariadb knowledge: https://mariadb.com/kb/en/ there're some book about mariadb/mysql internall and mysql internall documentation: http://dev.mysql.com/doc/internals/en/ java is a connect, you can check more at mariadb page: https://mariadb.com/products/connectors-plugins 2014-09-03 17:15 GMT-03:00 Kavneet Kaur : > Hi Djimeli, > > As far as I have studied about the code it's in java. If you wish to begin > it from basic of database, you can go for installation. You should go > through documentations also. Explore your interest and surf as much as you > can. > > All the best! > > > Date: Wed, 3 Sep 2014 15:35:24 + > > From: djkonr...@gmail.com > > To: maria-developers@lists.launchpad.net > > Subject: [Maria-developers] Interest in contributing to MariaDB > > > > > Hello > > > > My name is Djimeli Konrad and i am primarily a c/c++ > > programmer with some experience in php and mysql. I am new to open > > source and would like to contribute to mariadb so i wish i could get > > some pointers on how to begin. > > > > Thanks > > konrad > > > > ___ > > Mailing list: https://launchpad.net/~maria-developers > > Post to : maria-developers@lists.launchpad.net > > Unsubscribe : https://launchpad.net/~maria-developers > > More help : https://help.launchpad.net/ListHelp > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] no information about references - mysql bug 73757
Hi guys, there's a bug report about no precise information to solve a problem: http://bugs.mysql.com/bug.php?id=73757 test case: create table t11 (f1 integer primary key) engine innodb; alter table t11 add constraint c1 foreign key (f1) references t1(f1); /* Erro SQL (1005): Can't create table `teste`.`#sql-3f90_25c30` (errno: 150 "Foreign key constraint is incorrectly formed") */ should be better explain that reference table t1 don't exists or something like it should i report at jira, or just mysql bug database is ok? -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Learning about MariaDB, Getting Started
You are wellcome :) Em sábado, 23 de agosto de 2014, Kavneet Kaur escreveu: > Hi, > > Thank you everyone for such great suggestions. I will surely work upon all > the offered suggestions. This positive response of community has inspired > me even more. > > Regards, > Kavneet Kaur > -- > Date: Sat, 23 Aug 2014 03:48:06 -0300 > From: robe...@spadim.com.br > > To: spsrirampa...@gmail.com > > CC: maria-developers@lists.launchpad.net > > Subject: Re: [Maria-developers] Learning about MariaDB, Getting Started > > you done a nice work, a very well docummented blog with source code about > a MDEV, that's a small book :) very usefull, thank you doing that nice job > :) > there's mysql dev page, and there're some mysql internal books too , i > read this one (http://shop.oreilly.com/product/9780596009571.do), but > it's a bit "old", and i liked > it's a first step book, but i didn't found many info about optimizer, i > think that optimizer is a 'black magic' not well documented yet kkk, but > with time you can learn it from source, i will read it some day :) > another very good think is ask at irc, mail lists, and starting a job or > implementing a feature from jira bug tracker, many guys here help a lot > too, but solving a feature is easier and solve "problems" :) > > good look and good studies guy > > > 2014-08-23 2:31 GMT-03:00 sriram patil >: > > Thank you, Roberto for recommending my blog. :) > > Hi Kavneet, you can learn about the internals of how things work in > MariaDB, coding standards, etc. here > <http://dev.mysql.com/doc/internals/en/>. > > This will give you a good grasp about overall structure of the source code > and then you can look into specific details as you desire. > > Sriram. > > > On Fri, Aug 22, 2014 at 11:39 PM, Roberto Spadim > wrote: > > This one is nice to learn code too > > https://mariadb.atlassian.net/browse/MDEV-5359 > > http://srirampatil.tumblr.com/post/95257135000/adding-support-for-or-replace-if-not-exists-and-if > > > 2014-08-22 14:34 GMT-03:00 Kavneet Kaur >: > > > Hi, > > James, I am aiming to become am interested in data security and reducing > query time by increasing efficiency and computational speed. Coding and > optimizing codes are also cup of my tea. How can I contribute this in > MariaDB as it's the only open source database software that attracted me. > > Regards, > Kavneet Kaur > -- > Date: Fri, 22 Aug 2014 04:44:45 -0700 > From: actionmess...@yahoo.com > > Subject: Re: [Maria-developers] Learning about MariaDB, Getting Started > To: kavne...@outlook.com > ; > maria-developers@lists.launchpad.net > ; > ashish1...@gmail.com > > > Hi Kavneet and Ashish. > > Depends on what you're interested in working on, but here's some > suggestions. > > Direct link to currently open worklogs: > https://mariadb.atlassian.net/browse/MDEV-6629?filter=-4 > > Three easy MDEVs and some other areas to work on: > > - MDEV-6584 - not using tcp_fastopen > - MDEV-6555 - sql_log_bin should be SESSION_ONLY > - MDEV-5696 - Graceful MariaDB shutdown at Windows restart > - test and see if fixes are needed for SSL, Galera, Cassandra, GTID, IPv6 > or partition features. > > "Howto Add a New Command to the MySQL Server" Tutorial > > http://www.jebriggs.com/blog/2013/05/howto-add-a-new-command-to-the-mysql-server/ > > Thanks, James. > -- > *From:* Kavneet Kaur > > *To:* "maria-developers@lists.launchpad.net > " < > maria-developers@lists.launchpad.net > > > *Sent:* Thursday, August 21, 2014 11:49 PM > *Subject:* [Maria-developers] Learning about MariaDB > > Hi! I am highly interested in subject of database. I am also interested in > becoming a research developer. Worked on MS SQL. Want to try MariaDB. May I > get the guidance about this product as i'm totally new to it. Is there any > specific way to begin? > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to: maria-developers@lists.launchpad.net > > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > > > > -- > Roberto Sp
Re: [Maria-developers] Learning about MariaDB, Getting Started
you done a nice work, a very well docummented blog with source code about a MDEV, that's a small book :) very usefull, thank you doing that nice job :) there's mysql dev page, and there're some mysql internal books too , i read this one (http://shop.oreilly.com/product/9780596009571.do), but it's a bit "old", and i liked it's a first step book, but i didn't found many info about optimizer, i think that optimizer is a 'black magic' not well documented yet kkk, but with time you can learn it from source, i will read it some day :) another very good think is ask at irc, mail lists, and starting a job or implementing a feature from jira bug tracker, many guys here help a lot too, but solving a feature is easier and solve "problems" :) good look and good studies guy 2014-08-23 2:31 GMT-03:00 sriram patil : > Thank you, Roberto for recommending my blog. :) > > Hi Kavneet, you can learn about the internals of how things work in > MariaDB, coding standards, etc. here > <http://dev.mysql.com/doc/internals/en/>. > > This will give you a good grasp about overall structure of the source code > and then you can look into specific details as you desire. > > Sriram. > > > On Fri, Aug 22, 2014 at 11:39 PM, Roberto Spadim > wrote: > >> This one is nice to learn code too >> >> https://mariadb.atlassian.net/browse/MDEV-5359 >> >> http://srirampatil.tumblr.com/post/95257135000/adding-support-for-or-replace-if-not-exists-and-if >> >> >> 2014-08-22 14:34 GMT-03:00 Kavneet Kaur : >> >> >>> Hi, >>> >>> James, I am aiming to become am interested in data security and reducing >>> query time by increasing efficiency and computational speed. Coding and >>> optimizing codes are also cup of my tea. How can I contribute this in >>> MariaDB as it's the only open source database software that attracted me. >>> >>> Regards, >>> Kavneet Kaur >>> -- >>> Date: Fri, 22 Aug 2014 04:44:45 -0700 >>> From: actionmess...@yahoo.com >>> Subject: Re: [Maria-developers] Learning about MariaDB, Getting Started >>> To: kavne...@outlook.com; maria-developers@lists.launchpad.net; >>> ashish1...@gmail.com >>> >>> Hi Kavneet and Ashish. >>> >>> Depends on what you're interested in working on, but here's some >>> suggestions. >>> >>> Direct link to currently open worklogs: >>> https://mariadb.atlassian.net/browse/MDEV-6629?filter=-4 >>> >>> Three easy MDEVs and some other areas to work on: >>> >>> - MDEV-6584 - not using tcp_fastopen >>> - MDEV-6555 - sql_log_bin should be SESSION_ONLY >>> - MDEV-5696 - Graceful MariaDB shutdown at Windows restart >>> - test and see if fixes are needed for SSL, Galera, Cassandra, GTID, >>> IPv6 or partition features. >>> >>> "Howto Add a New Command to the MySQL Server" Tutorial >>> >>> http://www.jebriggs.com/blog/2013/05/howto-add-a-new-command-to-the-mysql-server/ >>> >>> Thanks, James. >>> -- >>> *From:* Kavneet Kaur >>> *To:* "maria-developers@lists.launchpad.net" < >>> maria-developers@lists.launchpad.net> >>> *Sent:* Thursday, August 21, 2014 11:49 PM >>> *Subject:* [Maria-developers] Learning about MariaDB >>> >>> Hi! I am highly interested in subject of database. I am also interested >>> in becoming a research developer. Worked on MS SQL. Want to try MariaDB. >>> May I get the guidance about this product as i'm totally new to it. Is >>> there any specific way to begin? >>> >>> ___ >>> Mailing list: https://launchpad.net/~maria-developers >>> Post to: maria-developers@lists.launchpad.net >>> Unsubscribe : https://launchpad.net/~maria-developers >>> More help : https://help.launchpad.net/ListHelp >>> >>> >>> >>> ___ >>> Mailing list: https://launchpad.net/~maria-developers >>> Post to : maria-developers@lists.launchpad.net >>> Unsubscribe : https://launchpad.net/~maria-developers >>> More help : https://help.launchpad.net/ListHelp >>> >>> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> >> ___ >> Mailing list: https://launchpad.net/~maria-developers >> Post to : maria-developers@lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-developers >> More help : https://help.launchpad.net/ListHelp >> >> > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Learning about MariaDB, Getting Started
This one is nice to learn code too https://mariadb.atlassian.net/browse/MDEV-5359 http://srirampatil.tumblr.com/post/95257135000/adding-support-for-or-replace-if-not-exists-and-if 2014-08-22 14:34 GMT-03:00 Kavneet Kaur : > > Hi, > > James, I am aiming to become am interested in data security and reducing > query time by increasing efficiency and computational speed. Coding and > optimizing codes are also cup of my tea. How can I contribute this in > MariaDB as it's the only open source database software that attracted me. > > Regards, > Kavneet Kaur > -- > Date: Fri, 22 Aug 2014 04:44:45 -0700 > From: actionmess...@yahoo.com > Subject: Re: [Maria-developers] Learning about MariaDB, Getting Started > To: kavne...@outlook.com; maria-developers@lists.launchpad.net; > ashish1...@gmail.com > > Hi Kavneet and Ashish. > > Depends on what you're interested in working on, but here's some > suggestions. > > Direct link to currently open worklogs: > https://mariadb.atlassian.net/browse/MDEV-6629?filter=-4 > > Three easy MDEVs and some other areas to work on: > > - MDEV-6584 - not using tcp_fastopen > - MDEV-6555 - sql_log_bin should be SESSION_ONLY > - MDEV-5696 - Graceful MariaDB shutdown at Windows restart > - test and see if fixes are needed for SSL, Galera, Cassandra, GTID, IPv6 > or partition features. > > "Howto Add a New Command to the MySQL Server" Tutorial > > http://www.jebriggs.com/blog/2013/05/howto-add-a-new-command-to-the-mysql-server/ > > Thanks, James. > -- > *From:* Kavneet Kaur > *To:* "maria-developers@lists.launchpad.net" < > maria-developers@lists.launchpad.net> > *Sent:* Thursday, August 21, 2014 11:49 PM > *Subject:* [Maria-developers] Learning about MariaDB > > Hi! I am highly interested in subject of database. I am also interested in > becoming a research developer. Worked on MS SQL. Want to try MariaDB. May I > get the guidance about this product as i'm totally new to it. Is there any > specific way to begin? > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to: maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Pencils down
+1 2014-08-20 17:16 GMT-03:00 Alexander Barkov : > Hi Sriram, > > > > On 08/20/2014 09:14 AM, sriram patil wrote: > >> Hi All, >> >> Following is the link to my pencils down blog post. You can go through >> it even if you have not followed my blog posts before. >> >> http://goo.gl/DqBgDe >> >> Thanks a lot for all your feedback and suggestions. >> > > Thank you very much that you chose MariaDB as your GSoC project! > You've done a really great job. MariaDB users will be very happy to take > advantage of the features that you implemented. > Good luck with your future endeavor! > > > >> Sriram. >> > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC2014] Self-tuning cost coefficients
very nice :) i didn't checked if the calculated values are being used at optimizer, but i checked that lsqr is working now (with negative values) i will execute some queries to check what change what is being saved at optimizer_cost_factors table, etc nice work :) 2014-08-20 4:50 GMT-03:00 Anshu Avinash : > Hi all, > > I have written a documentation for framework which I have created for > gathering and calculating cost coefficients for optimizer, as part of my > GSoC project. It is available at > http://igniting.in/gsoc2014/2014/08/20/documentation/. > > Any suggestions/reviews are welcome. > > Regards > Anshu Avinash > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Week Twelve!
=D yeap very nice =D 2014-08-14 2:52 GMT-03:00 Alexander Barkov : > Hello Sriram, > > > > > On 08/11/2014 09:13 AM, sriram patil wrote: > >> Hi All, >> >> Following is the link to my twelfth weeks blog post. >> >> http://goo.gl/Zkr86e >> >> Suggestions and/or reviews are welcome! >> > > > Very nice replication tests. > > Also, it's very good that you reduced some duplicate code > by introducing a new function build_trig_stmt_query(). > > Congratulations on the great job, as always! :) > > > >> Thanks, >> Sriram >> > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Getting Started
Hi, Ashish every feature request, bugs, etc etc are here: https://mariadb.atlassian.net/ 2014-08-14 5:58 GMT-03:00 Ashish Kedia : > Hi all, > > I am 3rd Year undergraduate student majoring in Information Technology > from India. I am new to MariaDB however I wish to contribute. I am well > acquainted with C++ and other tools required. > > Can someone help me find small tasks/bugs/projects to get started with ? > > Regards, > > Ashish Kedia, > 3rd Year Undergraduate Student, > Dept. of Information Technology, > National Institute of Technology Karnataka, Surathkal > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Week Eleven!
=] good job guy :) 2014-08-05 12:05 GMT-03:00 Alexander Barkov : > Hi Sriram, > > > > On 08/04/2014 09:29 AM, sriram patil wrote: > >> Hi All, >> >> Following is the link to the blog post for my eleventh week into GSoC >> >> http://goo.gl/TN3U0K >> >> Suggestions and/or reviews are welcome. >> > > Thanks for doing a very good job again! > > > >> Thanks, >> Sriram >> > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Introduction Mail
if you have time, you could take a look at linear programming lpsolve is a well know library, i used it a lot some years ago, there's others libs but this one is well known, http://lpsolve.sourceforge.net/5.5/ maybe it give better results, instead of trying to solve a equation you execute a aproximation (there's many optional parameters and others flags about solving a linear problem with this lib) 2014-08-04 13:35 GMT-03:00 Roberto Spadim : > i didn't read the code yet, but some min/max problems can add restrictions > about variables, for example you could set that variables are >=0 > must check but well that's a nice step guy :) a nice work :) > > > 2014-08-04 13:31 GMT-03:00 Anshu Avinash : > > Hi all, >> >> Here is a blog post describing my progress so far: >> http://igniting.in/gsoc2014/2014/08/04/progress-so-far/ >> >> Comments and suggestions are welcome. >> >> Regards >> Anshu Avinash >> >> >> On Wed, Jul 9, 2014 at 1:14 AM, Roberto Spadim >> wrote: >> >>> please include the output (solutions.txt) link too, to check what >>> happened >>> >>> 2014-07-08 16:24 GMT-03:00 Roberto Spadim : >>> > http://www.netlib.org/lapack/lapacke.html >>> > a C api to lapack >>> > >>> > 2014-07-08 16:23 GMT-03:00 Roberto Spadim : >>> >> check lapack lib, i used it some years ago, and it solve linear >>> >> equations, at least you don't waste time with 'how to solve linear >>> >> equations', if you want to study :) lapack was a nice lib, at least i >>> >> used without problems >>> >> >>> >> 2014-07-08 16:04 GMT-03:00 Roberto Spadim : >>> >>> a1,a2 is what your solve equation function is saving? >>> >>> and you want know t1,t2,t3..t130, to understand how much time each >>> >>> 'read function' take, that's it? >>> >>> >>> >>> doing this, what's the next step? this is a start point to select >>> >>> what's better? index vs table scan? >>> >>> >>> >>> >>> >>> >>> >>> 2014-07-08 15:54 GMT-03:00 Anshu Avinash >> >: >>> >>>> Hi, >>> >>>> >>> >>>> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. >>> We need >>> >>>> 130 linearly independent equations to solve for these variables. We >>> can >>> >>>> never get 130 linearly independent equations as some of the >>> coefficients >>> >>>> would be 0 every time. Hence, we get an approximate solution by >>> forming an >>> >>>> overdetermined system ( >>> http://en.wikipedia.org/wiki/Overdetermined_system). >>> >>>> Let me know if you have any further doubts. >>> >>>> >>> >>>> Regards >>> >>>> Anshu Avinash >>> >>>> >>> >>>> >>> >>>> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim < >>> robe...@spadim.com.br> >>> >>>> wrote: >>> >>>>> >>> >>>>> ops, linear equation >>> >>>>> >>> >>>>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim : >>> >>>>> > going back... >>> >>>>> > a1t1 + a2t2 + … + a130t130= ttotal >>> >>>>> > >>> >>>>> > a1, t1... >>> >>>>> > >>> >>>>> > a1 is something you don't know >>> >>>>> > t1 is the coefficients[i]? >>> >>>>> > >>> >>>>> > it's a first order equation, right? >>> >>>>> > >>> >>>>> > >>> >>>>> > >>> >>>>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash < >>> anshu.avinas...@gmail.com>: >>> >>>>> >> Hi, >>> >>>>> >> >>> >>>>> >> The idea is we know the total time the query took, and how many >>> times >>> >>>>> >> an >>> >>>>> >> operation was performed. For example, consider the case of >>> 'read_time'. >>> >>>>> >> We >>> >>>>> >> know how
Re: [Maria-developers] [GSoC] Introduction Mail
i didn't read the code yet, but some min/max problems can add restrictions about variables, for example you could set that variables are >=0 must check but well that's a nice step guy :) a nice work :) 2014-08-04 13:31 GMT-03:00 Anshu Avinash : > Hi all, > > Here is a blog post describing my progress so far: > http://igniting.in/gsoc2014/2014/08/04/progress-so-far/ > > Comments and suggestions are welcome. > > Regards > Anshu Avinash > > > On Wed, Jul 9, 2014 at 1:14 AM, Roberto Spadim > wrote: > >> please include the output (solutions.txt) link too, to check what happened >> >> 2014-07-08 16:24 GMT-03:00 Roberto Spadim : >> > http://www.netlib.org/lapack/lapacke.html >> > a C api to lapack >> > >> > 2014-07-08 16:23 GMT-03:00 Roberto Spadim : >> >> check lapack lib, i used it some years ago, and it solve linear >> >> equations, at least you don't waste time with 'how to solve linear >> >> equations', if you want to study :) lapack was a nice lib, at least i >> >> used without problems >> >> >> >> 2014-07-08 16:04 GMT-03:00 Roberto Spadim : >> >>> a1,a2 is what your solve equation function is saving? >> >>> and you want know t1,t2,t3..t130, to understand how much time each >> >>> 'read function' take, that's it? >> >>> >> >>> doing this, what's the next step? this is a start point to select >> >>> what's better? index vs table scan? >> >>> >> >>> >> >>> >> >>> 2014-07-08 15:54 GMT-03:00 Anshu Avinash : >> >>>> Hi, >> >>>> >> >>>> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. >> We need >> >>>> 130 linearly independent equations to solve for these variables. We >> can >> >>>> never get 130 linearly independent equations as some of the >> coefficients >> >>>> would be 0 every time. Hence, we get an approximate solution by >> forming an >> >>>> overdetermined system ( >> http://en.wikipedia.org/wiki/Overdetermined_system). >> >>>> Let me know if you have any further doubts. >> >>>> >> >>>> Regards >> >>>> Anshu Avinash >> >>>> >> >>>> >> >>>> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim < >> robe...@spadim.com.br> >> >>>> wrote: >> >>>>> >> >>>>> ops, linear equation >> >>>>> >> >>>>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim : >> >>>>> > going back... >> >>>>> > a1t1 + a2t2 + … + a130t130= ttotal >> >>>>> > >> >>>>> > a1, t1... >> >>>>> > >> >>>>> > a1 is something you don't know >> >>>>> > t1 is the coefficients[i]? >> >>>>> > >> >>>>> > it's a first order equation, right? >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash < >> anshu.avinas...@gmail.com>: >> >>>>> >> Hi, >> >>>>> >> >> >>>>> >> The idea is we know the total time the query took, and how many >> times >> >>>>> >> an >> >>>>> >> operation was performed. For example, consider the case of >> 'read_time'. >> >>>>> >> We >> >>>>> >> know how many times an index read took place, but don't know how >> much >> >>>>> >> time >> >>>>> >> does it take to do an index read. By solving these equations, we >> are >> >>>>> >> trying >> >>>>> >> to find out time for individual operations. >> coefficients[i].value is >> >>>>> >> `how >> >>>>> >> many time the operation i took place in a single query.` >> >>>>> >> >> >>>>> >> Hope this clears things up. >> >>>>> >> >> >>>>> >> Regards >> >>>>> >> Anshu Avinash >> >>>>> >> >>
Re: [Maria-developers] [Commits] Rev 4876: Post-fixes after UNIQUE index support was enabled without uniquenessenforcement. in file:///home/psergey/chroot/saucy-x64/home/psergey/dev2/mysql-5.6-rocksdb
=] nice rocksdb, any devel code to test it? i have some key-value databases to test 2014-07-11 13:21 GMT-03:00 Sergey Petrunya : > At > file:///home/psergey/chroot/saucy-x64/home/psergey/dev2/mysql-5.6-rocksdb-r2/ > > > revno: 4876 > revision-id: pser...@askmonty.org-20140711162114-051drr4tocqpbx30 > parent: pser...@askmonty.org-20140711161708-b50tdmlr60djrror > committer: Sergey Petrunya > branch nick: mysql-5.6-rocksdb-r2 > timestamp: Fri 2014-07-11 20:21:14 +0400 > message: > Post-fixes after UNIQUE index support was enabled without > uniquenessenforcement. > - Fix compile warning > - Fix the rocksdb.test/result > === modified file 'mysql-test/r/rocksdb.result' > --- a/mysql-test/r/rocksdb.result 2014-07-03 20:58:25 + > +++ b/mysql-test/r/rocksdb.result 2014-07-11 16:21:14 + > @@ -686,8 +686,8 @@ DROP TABLE t33; > # > # MDEV-4081: RocksDB throws error 122 on an attempt to create a table > with unique index > # > +# Unique indexes can be created, but uniqueness won't be enforced > create table t33 (pk int primary key, u int, unique index(u)) > engine=RocksDB; > -ERROR HY000: Got error 187 'Unique indexes are not supported' from ROCKSDB > # > # MDEV-4077: RocksDB: Wrong result (duplicate row) on select with range > # > > === modified file 'mysql-test/t/rocksdb.test' > --- a/mysql-test/t/rocksdb.test 2014-07-03 20:58:25 + > +++ b/mysql-test/t/rocksdb.test 2014-07-11 16:21:14 + > @@ -610,7 +610,8 @@ DROP TABLE t33; > --echo # > --echo # MDEV-4081: RocksDB throws error 122 on an attempt to create a > table with unique index > --echo # > ---error ER_GET_ERRMSG > +#--error ER_GET_ERRMSG > +--echo # Unique indexes can be created, but uniqueness won't be enforced > create table t33 (pk int primary key, u int, unique index(u)) > engine=RocksDB; > > > > === modified file 'storage/rocksdb/ha_rocksdb.cc' > --- a/storage/rocksdb/ha_rocksdb.cc 2014-07-09 23:46:24 + > +++ b/storage/rocksdb/ha_rocksdb.cc 2014-07-11 16:21:14 + > @@ -1051,7 +1051,7 @@ int ha_rocksdb::create(const char *name, >/* > We only support auto_increment at start of the PRIMARY KEY. >*/ > - Field *field; > + //Field *field; >//if ((field= table_arg->next_number_field)) >/* TODO mdcallag: disable this for now to let UNIQUE indexes kind of > work > if ((field= table_arg->found_next_number_field)) > > ___ > commits mailing list > comm...@mariadb.org > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Introduction Mail
please include the output (solutions.txt) link too, to check what happened 2014-07-08 16:24 GMT-03:00 Roberto Spadim : > http://www.netlib.org/lapack/lapacke.html > a C api to lapack > > 2014-07-08 16:23 GMT-03:00 Roberto Spadim : >> check lapack lib, i used it some years ago, and it solve linear >> equations, at least you don't waste time with 'how to solve linear >> equations', if you want to study :) lapack was a nice lib, at least i >> used without problems >> >> 2014-07-08 16:04 GMT-03:00 Roberto Spadim : >>> a1,a2 is what your solve equation function is saving? >>> and you want know t1,t2,t3..t130, to understand how much time each >>> 'read function' take, that's it? >>> >>> doing this, what's the next step? this is a start point to select >>> what's better? index vs table scan? >>> >>> >>> >>> 2014-07-08 15:54 GMT-03:00 Anshu Avinash : >>>> Hi, >>>> >>>> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. We need >>>> 130 linearly independent equations to solve for these variables. We can >>>> never get 130 linearly independent equations as some of the coefficients >>>> would be 0 every time. Hence, we get an approximate solution by forming an >>>> overdetermined system (http://en.wikipedia.org/wiki/Overdetermined_system). >>>> Let me know if you have any further doubts. >>>> >>>> Regards >>>> Anshu Avinash >>>> >>>> >>>> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim >>>> wrote: >>>>> >>>>> ops, linear equation >>>>> >>>>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim : >>>>> > going back... >>>>> > a1t1 + a2t2 + … + a130t130= ttotal >>>>> > >>>>> > a1, t1... >>>>> > >>>>> > a1 is something you don't know >>>>> > t1 is the coefficients[i]? >>>>> > >>>>> > it's a first order equation, right? >>>>> > >>>>> > >>>>> > >>>>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash : >>>>> >> Hi, >>>>> >> >>>>> >> The idea is we know the total time the query took, and how many times >>>>> >> an >>>>> >> operation was performed. For example, consider the case of 'read_time'. >>>>> >> We >>>>> >> know how many times an index read took place, but don't know how much >>>>> >> time >>>>> >> does it take to do an index read. By solving these equations, we are >>>>> >> trying >>>>> >> to find out time for individual operations. coefficients[i].value is >>>>> >> `how >>>>> >> many time the operation i took place in a single query.` >>>>> >> >>>>> >> Hope this clears things up. >>>>> >> >>>>> >> Regards >>>>> >> Anshu Avinash >>>>> >> >>>>> >> >>>>> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim >>>>> >> wrote: >>>>> >>> >>>>> >>> just to understand... >>>>> >>> --- the solve_equation part, today only used to save information: >>>>> >>> std::ofstream datafile; >>>>> >>> char file_name[100]; >>>>> >>> my_snprintf(file_name, 100, >>>>> >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >>>>> >>> datafile.open(file_name, std::ios::app); >>>>> >>> for(int i=0; i < MAX_CONSTANTS; i++) >>>>> >>> datafile << coefficients[i].value << " "; >>>>> >>> datafile << total_time << "\n"; >>>>> >>> datafile.close(); >>>>> >>> >>>>> >>> >>>>> >>> the idea is: given a query and some coefficients[i].value, you got >>>>> >>> total_time need to execute the query >>>>> >>> you want to "train" something to tell you how many time the same query >>>>> >>> should execute? >>>>
Re: [Maria-developers] [GSoC] Introduction Mail
http://www.netlib.org/lapack/lapacke.html a C api to lapack 2014-07-08 16:23 GMT-03:00 Roberto Spadim : > check lapack lib, i used it some years ago, and it solve linear > equations, at least you don't waste time with 'how to solve linear > equations', if you want to study :) lapack was a nice lib, at least i > used without problems > > 2014-07-08 16:04 GMT-03:00 Roberto Spadim : >> a1,a2 is what your solve equation function is saving? >> and you want know t1,t2,t3..t130, to understand how much time each >> 'read function' take, that's it? >> >> doing this, what's the next step? this is a start point to select >> what's better? index vs table scan? >> >> >> >> 2014-07-08 15:54 GMT-03:00 Anshu Avinash : >>> Hi, >>> >>> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. We need >>> 130 linearly independent equations to solve for these variables. We can >>> never get 130 linearly independent equations as some of the coefficients >>> would be 0 every time. Hence, we get an approximate solution by forming an >>> overdetermined system (http://en.wikipedia.org/wiki/Overdetermined_system). >>> Let me know if you have any further doubts. >>> >>> Regards >>> Anshu Avinash >>> >>> >>> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim >>> wrote: >>>> >>>> ops, linear equation >>>> >>>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim : >>>> > going back... >>>> > a1t1 + a2t2 + … + a130t130= ttotal >>>> > >>>> > a1, t1... >>>> > >>>> > a1 is something you don't know >>>> > t1 is the coefficients[i]? >>>> > >>>> > it's a first order equation, right? >>>> > >>>> > >>>> > >>>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash : >>>> >> Hi, >>>> >> >>>> >> The idea is we know the total time the query took, and how many times >>>> >> an >>>> >> operation was performed. For example, consider the case of 'read_time'. >>>> >> We >>>> >> know how many times an index read took place, but don't know how much >>>> >> time >>>> >> does it take to do an index read. By solving these equations, we are >>>> >> trying >>>> >> to find out time for individual operations. coefficients[i].value is >>>> >> `how >>>> >> many time the operation i took place in a single query.` >>>> >> >>>> >> Hope this clears things up. >>>> >> >>>> >> Regards >>>> >> Anshu Avinash >>>> >> >>>> >> >>>> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim >>>> >> wrote: >>>> >>> >>>> >>> just to understand... >>>> >>> --- the solve_equation part, today only used to save information: >>>> >>> std::ofstream datafile; >>>> >>> char file_name[100]; >>>> >>> my_snprintf(file_name, 100, >>>> >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >>>> >>> datafile.open(file_name, std::ios::app); >>>> >>> for(int i=0; i < MAX_CONSTANTS; i++) >>>> >>> datafile << coefficients[i].value << " "; >>>> >>> datafile << total_time << "\n"; >>>> >>> datafile.close(); >>>> >>> >>>> >>> >>>> >>> the idea is: given a query and some coefficients[i].value, you got >>>> >>> total_time need to execute the query >>>> >>> you want to "train" something to tell you how many time the same query >>>> >>> should execute? >>>> >>> or, what's the "x[i]" variables from your system (hardware/hard >>>> >>> disk/etc), and extend this to others queries? >>>> >>> >>>> >>> >>>> >>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim : >>>> >>> > =] nice >>>> >>> > >>>> >>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash >>>> >
Re: [Maria-developers] [GSoC] Introduction Mail
check lapack lib, i used it some years ago, and it solve linear equations, at least you don't waste time with 'how to solve linear equations', if you want to study :) lapack was a nice lib, at least i used without problems 2014-07-08 16:04 GMT-03:00 Roberto Spadim : > a1,a2 is what your solve equation function is saving? > and you want know t1,t2,t3..t130, to understand how much time each > 'read function' take, that's it? > > doing this, what's the next step? this is a start point to select > what's better? index vs table scan? > > > > 2014-07-08 15:54 GMT-03:00 Anshu Avinash : >> Hi, >> >> a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. We need >> 130 linearly independent equations to solve for these variables. We can >> never get 130 linearly independent equations as some of the coefficients >> would be 0 every time. Hence, we get an approximate solution by forming an >> overdetermined system (http://en.wikipedia.org/wiki/Overdetermined_system). >> Let me know if you have any further doubts. >> >> Regards >> Anshu Avinash >> >> >> On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim >> wrote: >>> >>> ops, linear equation >>> >>> 2014-07-08 15:47 GMT-03:00 Roberto Spadim : >>> > going back... >>> > a1t1 + a2t2 + … + a130t130= ttotal >>> > >>> > a1, t1... >>> > >>> > a1 is something you don't know >>> > t1 is the coefficients[i]? >>> > >>> > it's a first order equation, right? >>> > >>> > >>> > >>> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash : >>> >> Hi, >>> >> >>> >> The idea is we know the total time the query took, and how many times >>> >> an >>> >> operation was performed. For example, consider the case of 'read_time'. >>> >> We >>> >> know how many times an index read took place, but don't know how much >>> >> time >>> >> does it take to do an index read. By solving these equations, we are >>> >> trying >>> >> to find out time for individual operations. coefficients[i].value is >>> >> `how >>> >> many time the operation i took place in a single query.` >>> >> >>> >> Hope this clears things up. >>> >> >>> >> Regards >>> >> Anshu Avinash >>> >> >>> >> >>> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim >>> >> wrote: >>> >>> >>> >>> just to understand... >>> >>> --- the solve_equation part, today only used to save information: >>> >>> std::ofstream datafile; >>> >>> char file_name[100]; >>> >>> my_snprintf(file_name, 100, >>> >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >>> >>> datafile.open(file_name, std::ios::app); >>> >>> for(int i=0; i < MAX_CONSTANTS; i++) >>> >>> datafile << coefficients[i].value << " "; >>> >>> datafile << total_time << "\n"; >>> >>> datafile.close(); >>> >>> >>> >>> >>> >>> the idea is: given a query and some coefficients[i].value, you got >>> >>> total_time need to execute the query >>> >>> you want to "train" something to tell you how many time the same query >>> >>> should execute? >>> >>> or, what's the "x[i]" variables from your system (hardware/hard >>> >>> disk/etc), and extend this to others queries? >>> >>> >>> >>> >>> >>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim : >>> >>> > =] nice >>> >>> > >>> >>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash >>> >>> > : >>> >>> >> Hi all, >>> >>> >> >>> >>> >> You can download it here >>> >>> >> >>> >>> >> >>> >>> >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). >>> >>> >> It is around 26M. I have added the link on blog too. >>> >>> >> >>> >>> >> Regards
Re: [Maria-developers] [GSoC] Introduction Mail
a1,a2 is what your solve equation function is saving? and you want know t1,t2,t3..t130, to understand how much time each 'read function' take, that's it? doing this, what's the next step? this is a start point to select what's better? index vs table scan? 2014-07-08 15:54 GMT-03:00 Anshu Avinash : > Hi, > > a1, a2, ..., a130 are coefficients. t1, t2, .., t130 are unknowns. We need > 130 linearly independent equations to solve for these variables. We can > never get 130 linearly independent equations as some of the coefficients > would be 0 every time. Hence, we get an approximate solution by forming an > overdetermined system (http://en.wikipedia.org/wiki/Overdetermined_system). > Let me know if you have any further doubts. > > Regards > Anshu Avinash > > > On Wed, Jul 9, 2014 at 12:18 AM, Roberto Spadim > wrote: >> >> ops, linear equation >> >> 2014-07-08 15:47 GMT-03:00 Roberto Spadim : >> > going back... >> > a1t1 + a2t2 + … + a130t130= ttotal >> > >> > a1, t1... >> > >> > a1 is something you don't know >> > t1 is the coefficients[i]? >> > >> > it's a first order equation, right? >> > >> > >> > >> > 2014-07-08 15:20 GMT-03:00 Anshu Avinash : >> >> Hi, >> >> >> >> The idea is we know the total time the query took, and how many times >> >> an >> >> operation was performed. For example, consider the case of 'read_time'. >> >> We >> >> know how many times an index read took place, but don't know how much >> >> time >> >> does it take to do an index read. By solving these equations, we are >> >> trying >> >> to find out time for individual operations. coefficients[i].value is >> >> `how >> >> many time the operation i took place in a single query.` >> >> >> >> Hope this clears things up. >> >> >> >> Regards >> >> Anshu Avinash >> >> >> >> >> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim >> >> wrote: >> >>> >> >>> just to understand... >> >>> --- the solve_equation part, today only used to save information: >> >>> std::ofstream datafile; >> >>> char file_name[100]; >> >>> my_snprintf(file_name, 100, >> >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >> >>> datafile.open(file_name, std::ios::app); >> >>> for(int i=0; i < MAX_CONSTANTS; i++) >> >>> datafile << coefficients[i].value << " "; >> >>> datafile << total_time << "\n"; >> >>> datafile.close(); >> >>> >> >>> >> >>> the idea is: given a query and some coefficients[i].value, you got >> >>> total_time need to execute the query >> >>> you want to "train" something to tell you how many time the same query >> >>> should execute? >> >>> or, what's the "x[i]" variables from your system (hardware/hard >> >>> disk/etc), and extend this to others queries? >> >>> >> >>> >> >>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim : >> >>> > =] nice >> >>> > >> >>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash >> >>> > : >> >>> >> Hi all, >> >>> >> >> >>> >> You can download it here >> >>> >> >> >>> >> >> >>> >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). >> >>> >> It is around 26M. I have added the link on blog too. >> >>> >> >> >>> >> Regards >> >>> >> Anshu >> >>> >> >> >>> >> >> >>> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim >> >>> >> >> >>> >> wrote: >> >>> >>> >> >>> >>> could you 'display' the dataset you used with octave? >> >>> >>> >> >>> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash >> >>> >>> : >> >>> >>> > Hi all, >> >>> >>> > >> >>> >>> > This week's blog post is at:
Re: [Maria-developers] [GSoC] Introduction Mail
ops, linear equation 2014-07-08 15:47 GMT-03:00 Roberto Spadim : > going back... > a1t1 + a2t2 + … + a130t130= ttotal > > a1, t1... > > a1 is something you don't know > t1 is the coefficients[i]? > > it's a first order equation, right? > > > > 2014-07-08 15:20 GMT-03:00 Anshu Avinash : >> Hi, >> >> The idea is we know the total time the query took, and how many times an >> operation was performed. For example, consider the case of 'read_time'. We >> know how many times an index read took place, but don't know how much time >> does it take to do an index read. By solving these equations, we are trying >> to find out time for individual operations. coefficients[i].value is `how >> many time the operation i took place in a single query.` >> >> Hope this clears things up. >> >> Regards >> Anshu Avinash >> >> >> On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim >> wrote: >>> >>> just to understand... >>> --- the solve_equation part, today only used to save information: >>> std::ofstream datafile; >>> char file_name[100]; >>> my_snprintf(file_name, 100, >>> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >>> datafile.open(file_name, std::ios::app); >>> for(int i=0; i < MAX_CONSTANTS; i++) >>> datafile << coefficients[i].value << " "; >>> datafile << total_time << "\n"; >>> datafile.close(); >>> >>> >>> the idea is: given a query and some coefficients[i].value, you got >>> total_time need to execute the query >>> you want to "train" something to tell you how many time the same query >>> should execute? >>> or, what's the "x[i]" variables from your system (hardware/hard >>> disk/etc), and extend this to others queries? >>> >>> >>> 2014-07-08 14:20 GMT-03:00 Roberto Spadim : >>> > =] nice >>> > >>> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash : >>> >> Hi all, >>> >> >>> >> You can download it here >>> >> >>> >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). >>> >> It is around 26M. I have added the link on blog too. >>> >> >>> >> Regards >>> >> Anshu >>> >> >>> >> >>> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim >>> >> wrote: >>> >>> >>> >>> could you 'display' the dataset you used with octave? >>> >>> >>> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash : >>> >>> > Hi all, >>> >>> > >>> >>> > This week's blog post is at: >>> >>> > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ . >>> >>> > Sorry >>> >>> > for >>> >>> > the delay. >>> >>> > Suggestions for an approach to solve the system of linear equations >>> >>> > are >>> >>> > welcome. >>> >>> > >>> >>> > Regards >>> >>> > Anshu Avinash >>> >>> > >>> >>> > >>> >>> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim >>> >>> > >>> >>> > wrote: >>> >>> >> >>> >>> >> " MDEV. " >>> >>> >> it's nice to put full name (MDEV-350), since google and others >>> >>> >> search >>> >>> >> engines help when someone try to find information about mdev 350 >>> >>> >> >>> >>> >> text is ok :) >>> >>> >> >>> >>> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash >>> >>> >> : >>> >>> >> > Hi, >>> >>> >> > >>> >>> >> > Sorry for the confusion, this is the new link: >>> >>> >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >>> >>> >> > Thanks for pointing out. >>> >>> >> > >>> >>> >> > Regards >>> >>> >> > Anshu >>> >>> >> > >>> >>> >> > >&
Re: [Maria-developers] [GSoC] Introduction Mail
going back... a1t1 + a2t2 + … + a130t130= ttotal a1, t1... a1 is something you don't know t1 is the coefficients[i]? it's a first order equation, right? 2014-07-08 15:20 GMT-03:00 Anshu Avinash : > Hi, > > The idea is we know the total time the query took, and how many times an > operation was performed. For example, consider the case of 'read_time'. We > know how many times an index read took place, but don't know how much time > does it take to do an index read. By solving these equations, we are trying > to find out time for individual operations. coefficients[i].value is `how > many time the operation i took place in a single query.` > > Hope this clears things up. > > Regards > Anshu Avinash > > > On Tue, Jul 8, 2014 at 10:57 PM, Roberto Spadim > wrote: >> >> just to understand... >> --- the solve_equation part, today only used to save information: >> std::ofstream datafile; >> char file_name[100]; >> my_snprintf(file_name, 100, >> "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); >> datafile.open(file_name, std::ios::app); >> for(int i=0; i < MAX_CONSTANTS; i++) >> datafile << coefficients[i].value << " "; >> datafile << total_time << "\n"; >> datafile.close(); >> >> >> the idea is: given a query and some coefficients[i].value, you got >> total_time need to execute the query >> you want to "train" something to tell you how many time the same query >> should execute? >> or, what's the "x[i]" variables from your system (hardware/hard >> disk/etc), and extend this to others queries? >> >> >> 2014-07-08 14:20 GMT-03:00 Roberto Spadim : >> > =] nice >> > >> > 2014-07-08 14:18 GMT-03:00 Anshu Avinash : >> >> Hi all, >> >> >> >> You can download it here >> >> >> >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). >> >> It is around 26M. I have added the link on blog too. >> >> >> >> Regards >> >> Anshu >> >> >> >> >> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim >> >> wrote: >> >>> >> >>> could you 'display' the dataset you used with octave? >> >>> >> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash : >> >>> > Hi all, >> >>> > >> >>> > This week's blog post is at: >> >>> > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ . >> >>> > Sorry >> >>> > for >> >>> > the delay. >> >>> > Suggestions for an approach to solve the system of linear equations >> >>> > are >> >>> > welcome. >> >>> > >> >>> > Regards >> >>> > Anshu Avinash >> >>> > >> >>> > >> >>> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim >> >>> > >> >>> > wrote: >> >>> >> >> >>> >> " MDEV. " >> >>> >> it's nice to put full name (MDEV-350), since google and others >> >>> >> search >> >>> >> engines help when someone try to find information about mdev 350 >> >>> >> >> >>> >> text is ok :) >> >>> >> >> >>> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash >> >>> >> : >> >>> >> > Hi, >> >>> >> > >> >>> >> > Sorry for the confusion, this is the new link: >> >>> >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >> >>> >> > Thanks for pointing out. >> >>> >> > >> >>> >> > Regards >> >>> >> > Anshu >> >>> >> > >> >>> >> > >> >>> >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim >> >>> >> > >> >>> >> > wrote: >> >>> >> >> >> >>> >> >> "Sorry this page does not exist =(" >> >>> >> >> >> >>> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash >> >>> >> >> : >> >>> >> >> > Hi all, >> >>>
Re: [Maria-developers] [GSoC] Introduction Mail
just to understand... --- the solve_equation part, today only used to save information: std::ofstream datafile; char file_name[100]; my_snprintf(file_name, 100, "/tmp/mariadb_cost_coefficients_%lu.txt", thread_id); datafile.open(file_name, std::ios::app); for(int i=0; i < MAX_CONSTANTS; i++) datafile << coefficients[i].value << " "; datafile << total_time << "\n"; datafile.close(); the idea is: given a query and some coefficients[i].value, you got total_time need to execute the query you want to "train" something to tell you how many time the same query should execute? or, what's the "x[i]" variables from your system (hardware/hard disk/etc), and extend this to others queries? 2014-07-08 14:20 GMT-03:00 Roberto Spadim : > =] nice > > 2014-07-08 14:18 GMT-03:00 Anshu Avinash : >> Hi all, >> >> You can download it here >> (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). >> It is around 26M. I have added the link on blog too. >> >> Regards >> Anshu >> >> >> On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim >> wrote: >>> >>> could you 'display' the dataset you used with octave? >>> >>> 2014-07-08 13:55 GMT-03:00 Anshu Avinash : >>> > Hi all, >>> > >>> > This week's blog post is at: >>> > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ . Sorry >>> > for >>> > the delay. >>> > Suggestions for an approach to solve the system of linear equations are >>> > welcome. >>> > >>> > Regards >>> > Anshu Avinash >>> > >>> > >>> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim >>> > wrote: >>> >> >>> >> " MDEV. " >>> >> it's nice to put full name (MDEV-350), since google and others search >>> >> engines help when someone try to find information about mdev 350 >>> >> >>> >> text is ok :) >>> >> >>> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash : >>> >> > Hi, >>> >> > >>> >> > Sorry for the confusion, this is the new link: >>> >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >>> >> > Thanks for pointing out. >>> >> > >>> >> > Regards >>> >> > Anshu >>> >> > >>> >> > >>> >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim >>> >> > >>> >> > wrote: >>> >> >> >>> >> >> "Sorry this page does not exist =(" >>> >> >> >>> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash : >>> >> >> > Hi all, >>> >> >> > >>> >> >> > You can find this week's blog entry at: >>> >> >> > http://igniting.in/2014/06/23/work-before-mid-term/ >>> >> >> > Suggestions/reviews are welcome. >>> >> >> > >>> >> >> > Regards >>> >> >> > Anshu Avinash >>> >> >> > >>> >> >> > >>> >> >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim >>> >> >> > >>> >> >> > wrote: >>> >> >> >> >>> >> >> >> Well i wws reading your posts >>> >> >> >> Do you need big data to test read and scan times? >>> >> >> >> >>> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >>> >> >> >> escreveu: >>> >> >> >> >>> >> >> >>> Hi all, >>> >> >> >>> >>> >> >> >>> You can find this week's blog entry at >>> >> >> >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now >>> >> >> >>> maintaining the >>> >> >> >>> code only on github: >>> >> >> >>> https://github.com/igniting/server/tree/selfTuningOptimizer. >>> >> >> >>> >>> >> >> >>> Regards >>> >> >> >>> Anshu Avinash >>> >> >> >>> >>> >> >> >>&
Re: [Maria-developers] [GSoC] Introduction Mail
=] nice 2014-07-08 14:18 GMT-03:00 Anshu Avinash : > Hi all, > > You can download it here > (https://drive.google.com/file/d/0B7NiQb4EbbUVNVJFZ2xkRVR3Ylk/edit?usp=sharing). > It is around 26M. I have added the link on blog too. > > Regards > Anshu > > > On Tue, Jul 8, 2014 at 10:38 PM, Roberto Spadim > wrote: >> >> could you 'display' the dataset you used with octave? >> >> 2014-07-08 13:55 GMT-03:00 Anshu Avinash : >> > Hi all, >> > >> > This week's blog post is at: >> > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ . Sorry >> > for >> > the delay. >> > Suggestions for an approach to solve the system of linear equations are >> > welcome. >> > >> > Regards >> > Anshu Avinash >> > >> > >> > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim >> > wrote: >> >> >> >> " MDEV. " >> >> it's nice to put full name (MDEV-350), since google and others search >> >> engines help when someone try to find information about mdev 350 >> >> >> >> text is ok :) >> >> >> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash : >> >> > Hi, >> >> > >> >> > Sorry for the confusion, this is the new link: >> >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >> >> > Thanks for pointing out. >> >> > >> >> > Regards >> >> > Anshu >> >> > >> >> > >> >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim >> >> > >> >> > wrote: >> >> >> >> >> >> "Sorry this page does not exist =(" >> >> >> >> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash : >> >> >> > Hi all, >> >> >> > >> >> >> > You can find this week's blog entry at: >> >> >> > http://igniting.in/2014/06/23/work-before-mid-term/ >> >> >> > Suggestions/reviews are welcome. >> >> >> > >> >> >> > Regards >> >> >> > Anshu Avinash >> >> >> > >> >> >> > >> >> >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim >> >> >> > >> >> >> > wrote: >> >> >> >> >> >> >> >> Well i wws reading your posts >> >> >> >> Do you need big data to test read and scan times? >> >> >> >> >> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >> >> >> >> escreveu: >> >> >> >> >> >> >> >>> Hi all, >> >> >> >>> >> >> >> >>> You can find this week's blog entry at >> >> >> >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now >> >> >> >>> maintaining the >> >> >> >>> code only on github: >> >> >> >>> https://github.com/igniting/server/tree/selfTuningOptimizer. >> >> >> >>> >> >> >> >>> Regards >> >> >> >>> Anshu Avinash >> >> >> >>> >> >> >> >>> >> >> >> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash >> >> >> >>> wrote: >> >> >> >>> >> >> >> >>> Hi all, >> >> >> >>> >> >> >> >>> You can find my this week's blog entry at >> >> >> >>> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ . I >> >> >> >>> have >> >> >> >>> created a >> >> >> >>> branch on launchpad for my work: >> >> >> >>> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 >> >> >> >>> . >> >> >> >>> You >> >> >> >>> can >> >> >> >>> give your suggestions/reviews either on this thread or as a >> >> >> >>> comment >> >> >> >>> on >> >> >> >>> the >> >> >> >>> blog itself. >> >> >> >>> >> >> &
Re: [Maria-developers] [GSoC] Introduction Mail
could you 'display' the dataset you used with octave? 2014-07-08 13:55 GMT-03:00 Anshu Avinash : > Hi all, > > This week's blog post is at: > http://igniting.in/gsoc2014/2014/07/08/solving-linear-equations/ . Sorry for > the delay. > Suggestions for an approach to solve the system of linear equations are > welcome. > > Regards > Anshu Avinash > > > On Mon, Jun 23, 2014 at 7:39 PM, Roberto Spadim > wrote: >> >> " MDEV. " >> it's nice to put full name (MDEV-350), since google and others search >> engines help when someone try to find information about mdev 350 >> >> text is ok :) >> >> 2014-06-23 11:04 GMT-03:00 Anshu Avinash : >> > Hi, >> > >> > Sorry for the confusion, this is the new link: >> > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ >> > Thanks for pointing out. >> > >> > Regards >> > Anshu >> > >> > >> > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim >> > wrote: >> >> >> >> "Sorry this page does not exist =(" >> >> >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash : >> >> > Hi all, >> >> > >> >> > You can find this week's blog entry at: >> >> > http://igniting.in/2014/06/23/work-before-mid-term/ >> >> > Suggestions/reviews are welcome. >> >> > >> >> > Regards >> >> > Anshu Avinash >> >> > >> >> > >> >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim >> >> > >> >> > wrote: >> >> >> >> >> >> Well i wws reading your posts >> >> >> Do you need big data to test read and scan times? >> >> >> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >> >> >> escreveu: >> >> >> >> >> >>> Hi all, >> >> >>> >> >> >>> You can find this week's blog entry at >> >> >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now >> >> >>> maintaining the >> >> >>> code only on github: >> >> >>> https://github.com/igniting/server/tree/selfTuningOptimizer. >> >> >>> >> >> >>> Regards >> >> >>> Anshu Avinash >> >> >>> >> >> >>> >> >> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash >> >> >>> wrote: >> >> >>> >> >> >>> Hi all, >> >> >>> >> >> >>> You can find my this week's blog entry at >> >> >>> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ . I have >> >> >>> created a >> >> >>> branch on launchpad for my work: >> >> >>> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 . >> >> >>> You >> >> >>> can >> >> >>> give your suggestions/reviews either on this thread or as a comment >> >> >>> on >> >> >>> the >> >> >>> blog itself. >> >> >>> >> >> >>> Regards >> >> >>> Anshu Avinash >> >> >>> >> >> >>> >> >> >>> On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim >> >> >>> >> >> >>> wrote: >> >> >>> >> >> >>> wow a big work, congratulation guy, i will read part by part to >> >> >>> better >> >> >>> understand mariadb code >> >> >>> >> >> >>> >> >> >>> 2014-05-19 16:33 GMT-03:00 Anshu Avinash >> >> >>> : >> >> >>> >> >> >>> Hi all, >> >> >>> >> >> >>> This week's blog entry would get delayed by couple of days. I have >> >> >>> started coding though and would like to give heads up on what I'm >> >> >>> doing. >> >> >>> >> >> >>> I've looked at the diffs for "Cost model project" of mysql: >> >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596 >> >> >>> and >> >> >>> http://bazaar.l
[Maria-developers] doubt about commit and myisam/aria engine
hi guys, i'm with a doubt... when a aria or myisam file is fsync to disk? when i execute commit? when i execute a autocommit? -- Roberto Spadim SPAEmpresarial ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Week Six!
Hi, I'm just watching :) a nice work, congratulations guy :) 2014-06-30 10:25 GMT-03:00 Alexander Barkov : > Hi Sriram, > > > > On 06/30/2014 08:27 AM, sriram patil wrote: >> >> Hi all, >> >> Following is the blog link about my sixth week into GSoC. >> >> http://goo.gl/1dzgHe >> >> Suggestions and/or reviews are welcome! > > > As a mentor I'm very happy about your performance and self-motivation! > Keep on doing the great job! > > Thanks. > >> >> Thanks, >> Sriram > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Commits] Rev 3855: Bumping server version. (10.0.13-galera) in lp:~maria-captains/maria/maria-10.0-galera
=] nice nirbhay 2014-06-30 10:33 GMT-03:00 Nirbhay Choubey : > Hi, > > On Mon, Jun 30, 2014 at 9:13 AM, Roberto Spadim > wrote: >> >> this will be a production ready version? > > > 10.0.12-galera (released over weekend) is the first 10.0-galera stable > release. This 'patch version bump' is > for preparation towards the next release. > > Best, > Nirbhay > >> >> >> 2014-06-30 10:03 GMT-03:00 Nirbhay Choubey : >> > At lp:~maria-captains/maria/maria-10.0-galera >> > >> > >> > revno: 3855 >> > revision-id: nirb...@skysql.com-20140630130329-w8kiirtf3blli7l1 >> > parent: nirb...@skysql.com-20140626161112-q1iqtoyq5owutvvb >> > committer: Nirbhay Choubey >> > branch nick: maria-10.0-galera >> > timestamp: Mon 2014-06-30 09:03:29 -0400 >> > message: >> > Bumping server version. (10.0.13-galera) >> > >> > === modified file 'VERSION' >> > --- a/VERSION 2014-06-19 17:12:38 + >> > +++ b/VERSION 2014-06-30 13:03:29 + >> > @@ -4,5 +4,5 @@ >> > # >> > MYSQL_VERSION_MAJOR=10 >> > MYSQL_VERSION_MINOR=0 >> > -MYSQL_VERSION_PATCH=12 >> > +MYSQL_VERSION_PATCH=13 >> > MYSQL_VERSION_EXTRA= >> > >> > >> > ___ >> > commits mailing list >> > comm...@mariadb.org >> > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits >> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> ___ >> commits mailing list >> comm...@mariadb.org >> https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits > > > > ___ > commits mailing list > comm...@mariadb.org > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Commits] Rev 3855: Bumping server version. (10.0.13-galera) in lp:~maria-captains/maria/maria-10.0-galera
this will be a production ready version? 2014-06-30 10:03 GMT-03:00 Nirbhay Choubey : > At lp:~maria-captains/maria/maria-10.0-galera > > > revno: 3855 > revision-id: nirb...@skysql.com-20140630130329-w8kiirtf3blli7l1 > parent: nirb...@skysql.com-20140626161112-q1iqtoyq5owutvvb > committer: Nirbhay Choubey > branch nick: maria-10.0-galera > timestamp: Mon 2014-06-30 09:03:29 -0400 > message: > Bumping server version. (10.0.13-galera) > > === modified file 'VERSION' > --- a/VERSION 2014-06-19 17:12:38 + > +++ b/VERSION 2014-06-30 13:03:29 + > @@ -4,5 +4,5 @@ > # > MYSQL_VERSION_MAJOR=10 > MYSQL_VERSION_MINOR=0 > -MYSQL_VERSION_PATCH=12 > +MYSQL_VERSION_PATCH=13 > MYSQL_VERSION_EXTRA= > > > ___ > commits mailing list > comm...@mariadb.org > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Introduction Mail
" MDEV. " it's nice to put full name (MDEV-350), since google and others search engines help when someone try to find information about mdev 350 text is ok :) 2014-06-23 11:04 GMT-03:00 Anshu Avinash : > Hi, > > Sorry for the confusion, this is the new link: > http://igniting.in/gsoc2014/2014/06/23/work-before-mid-term/ > Thanks for pointing out. > > Regards > Anshu > > > On Mon, Jun 23, 2014 at 7:32 PM, Roberto Spadim > wrote: >> >> "Sorry this page does not exist =(" >> >> 2014-06-23 8:07 GMT-03:00 Anshu Avinash : >> > Hi all, >> > >> > You can find this week's blog entry at: >> > http://igniting.in/2014/06/23/work-before-mid-term/ >> > Suggestions/reviews are welcome. >> > >> > Regards >> > Anshu Avinash >> > >> > >> > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim >> > wrote: >> >> >> >> Well i wws reading your posts >> >> Do you need big data to test read and scan times? >> >> >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >> >> escreveu: >> >> >> >>> Hi all, >> >>> >> >>> You can find this week's blog entry at >> >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now >> >>> maintaining the >> >>> code only on github: >> >>> https://github.com/igniting/server/tree/selfTuningOptimizer. >> >>> >> >>> Regards >> >>> Anshu Avinash >> >>> >> >>> >> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash >> >>> wrote: >> >>> >> >>> Hi all, >> >>> >> >>> You can find my this week's blog entry at >> >>> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ . I have >> >>> created a >> >>> branch on launchpad for my work: >> >>> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 . You >> >>> can >> >>> give your suggestions/reviews either on this thread or as a comment on >> >>> the >> >>> blog itself. >> >>> >> >>> Regards >> >>> Anshu Avinash >> >>> >> >>> >> >>> On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim >> >>> >> >>> wrote: >> >>> >> >>> wow a big work, congratulation guy, i will read part by part to better >> >>> understand mariadb code >> >>> >> >>> >> >>> 2014-05-19 16:33 GMT-03:00 Anshu Avinash : >> >>> >> >>> Hi all, >> >>> >> >>> This week's blog entry would get delayed by couple of days. I have >> >>> started coding though and would like to give heads up on what I'm >> >>> doing. >> >>> >> >>> I've looked at the diffs for "Cost model project" of mysql: >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596 and >> >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7222 . >> >>> These >> >>> give a pretty good idea about what are the hard-coded constants and >> >>> where >> >>> are they being used. >> >>> >> >>> The idea is to multiply "READ_TIME_FACTOR" and "SCAN_TIME_FACTOR" to >> >>> the >> >>> values returned by read_time() and scan_time() in handler.h, while >> >>> returning. These values would be read from a table in mysql db. For >> >>> that >> >>> I've looked at sql_statistics.cc. After completing this, I'll first >> >>> change >> >>> the values of these constants manually and check if the better or >> >>> worse >> >>> query plans are being selected. I'll first do the last step manually, >> >>> to >> >>> check if everything is working as expected and later automate it. >> >>> >> >>> Regards >> >>> Anshu >> >>> >> >>> >> >>> On Mon, May 12, 2014 at 11:22 AM, Anshu Avinash >> >>> wrote: >> >>> >> >>> Hi all, >> >>> >> >>> You can find my blog entry for this week at >> >>> http://igniting.in/gsoc2014/2014/05/11/first-steps/ . >> >>> >> >>> Regards >> >>> Anshu Avinash >> >>> >> >>> >> >>> On Thu, May 8, 2014 at 11:46 PM, Anshu Avinash >> >>> wrote: >> >>> >> >>> Hi all, >> >>> >> >>> Sorry for the irregular updates. I had been busy for last couple of >> >>> days >> >>> and might still be busy for 1-2 days more. I would be completely free >> >>> starting next week, and would be updating my blog weekly on every >> >>> Monday (so >> >>> 1st update would be on May 12). I would also send the link of my post >> >>> weekly >> >>> on the mailing list. >> >>> >> >>> As discussed on irc, I started to explore the pair of constants: >> >>> handler::scan_time() and handler::read_time(). >> >> >> >> >> >> >> >> -- >> >> Roberto Spadim >> >> SPAEmpresarial >> >> Eng. Automação e Controle >> >> >> > >> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Introduction Mail
"Sorry this page does not exist =(" 2014-06-23 8:07 GMT-03:00 Anshu Avinash : > Hi all, > > You can find this week's blog entry at: > http://igniting.in/2014/06/23/work-before-mid-term/ > Suggestions/reviews are welcome. > > Regards > Anshu Avinash > > > On Mon, Jun 9, 2014 at 7:30 PM, Roberto Spadim > wrote: >> >> Well i wws reading your posts >> Do you need big data to test read and scan times? >> >> Em segunda-feira, 9 de junho de 2014, Anshu Avinash >> escreveu: >> >>> Hi all, >>> >>> You can find this week's blog entry at >>> http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now maintaining the >>> code only on github: >>> https://github.com/igniting/server/tree/selfTuningOptimizer. >>> >>> Regards >>> Anshu Avinash >>> >>> >>> On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash >>> wrote: >>> >>> Hi all, >>> >>> You can find my this week's blog entry at >>> http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ . I have created a >>> branch on launchpad for my work: >>> http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 . You can >>> give your suggestions/reviews either on this thread or as a comment on the >>> blog itself. >>> >>> Regards >>> Anshu Avinash >>> >>> >>> On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim >>> wrote: >>> >>> wow a big work, congratulation guy, i will read part by part to better >>> understand mariadb code >>> >>> >>> 2014-05-19 16:33 GMT-03:00 Anshu Avinash : >>> >>> Hi all, >>> >>> This week's blog entry would get delayed by couple of days. I have >>> started coding though and would like to give heads up on what I'm doing. >>> >>> I've looked at the diffs for "Cost model project" of mysql: >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596 and >>> http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7222 . These >>> give a pretty good idea about what are the hard-coded constants and where >>> are they being used. >>> >>> The idea is to multiply "READ_TIME_FACTOR" and "SCAN_TIME_FACTOR" to the >>> values returned by read_time() and scan_time() in handler.h, while >>> returning. These values would be read from a table in mysql db. For that >>> I've looked at sql_statistics.cc. After completing this, I'll first change >>> the values of these constants manually and check if the better or worse >>> query plans are being selected. I'll first do the last step manually, to >>> check if everything is working as expected and later automate it. >>> >>> Regards >>> Anshu >>> >>> >>> On Mon, May 12, 2014 at 11:22 AM, Anshu Avinash >>> wrote: >>> >>> Hi all, >>> >>> You can find my blog entry for this week at >>> http://igniting.in/gsoc2014/2014/05/11/first-steps/ . >>> >>> Regards >>> Anshu Avinash >>> >>> >>> On Thu, May 8, 2014 at 11:46 PM, Anshu Avinash >>> wrote: >>> >>> Hi all, >>> >>> Sorry for the irregular updates. I had been busy for last couple of days >>> and might still be busy for 1-2 days more. I would be completely free >>> starting next week, and would be updating my blog weekly on every Monday (so >>> 1st update would be on May 12). I would also send the link of my post weekly >>> on the mailing list. >>> >>> As discussed on irc, I started to explore the pair of constants: >>> handler::scan_time() and handler::read_time(). >> >> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
:) very nice I will wait :) Em sexta-feira, 20 de junho de 2014, Elmar Eperiesi-Beck < el...@eperiesi-beck.de> escreveu: > 1) thats a good point, we will extend our coding to mysql_connect > > 2) yes, we want to do this with an INSERT statement - a bit more complex, > but yes…. > > We will update the concept paper and come back to you beginning of next > week. > > > Am 20.06.2014 um 16:28 schrieb Roberto Spadim >: > > > nice, check what i'm thinking about... > > 1) > > i start mariadb without keys > > i start my app > > here i must check that all tables are 'unlocked' and read to use, > > we will have a method to this? at mysql_connect i will check if keys > > are loaded, maybe a SHOW STATUS like 'encryption_keys_loaded' = 1 or 0 > > > > 2) > > about externall acess to include encryption/key > > maybe a sql statment? > > INSERT INTO mysql.encrypt_keys (key,value) value (1,"abcdefg.") > > > > just an idea about external key uploading > > or an external server (no problem) > > > > > > > > > > > > 2014-06-20 9:51 GMT-03:00 Elmar Eperiesi-Beck >: > >> At startup the keys will be read once and kept in memory. Normaly you > are > >> not going to encrypt 1000 tables, because you just encrypt the content > that > >> is confidential. But yes- each key has to be in the memory. Or you use > an > >> external encryption/key server that handels the encryption and the > >> key-management outside the DB. > >> > >> We enhanced the concept, that it is possible to deliver the key > manually at > >> server startup. You can have it e.g. on a pendrive and start the server > with > >> the keys as a backup. > >> > >> > >> > >> Am 17.06.2014 um 18:55 schrieb Roberto Spadim >: > >> > >> humm, now i'm thinking as a data warehouse > >> think about installing a server (server 1) in somewhere (maybe saara > >> desert) i connect the "server 1" to internet, and configure the > server > >> uri to point to my central server (server central), maybe at moon > >> > >> when the mysqld/mariadbd start, it will contact the central server and > get > >> all keys, or only get keys when i need? for example a server with 1000 > >> tables and 1000 diferent keys, they are all stored at memory at boot > time, > >> or only when i need read/write access to that table? > >> > >> if i remove the internet link, the "server 1" will not read tables, > right? > >> in this case, if i have the keyfile in a pendrive, or a cd or dvd, > could i > >> redirect it to a key file and start database, as a backup solution? > >> > >> > >> > > > > > > > > -- > > Roberto Spadim > > SPAEmpresarial > > Eng. Automação e Controle > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
nice, check what i'm thinking about... 1) i start mariadb without keys i start my app here i must check that all tables are 'unlocked' and read to use, we will have a method to this? at mysql_connect i will check if keys are loaded, maybe a SHOW STATUS like 'encryption_keys_loaded' = 1 or 0 2) about externall acess to include encryption/key maybe a sql statment? INSERT INTO mysql.encrypt_keys (key,value) value (1,"abcdefg.") just an idea about external key uploading or an external server (no problem) 2014-06-20 9:51 GMT-03:00 Elmar Eperiesi-Beck : > At startup the keys will be read once and kept in memory. Normaly you are > not going to encrypt 1000 tables, because you just encrypt the content that > is confidential. But yes- each key has to be in the memory. Or you use an > external encryption/key server that handels the encryption and the > key-management outside the DB. > > We enhanced the concept, that it is possible to deliver the key manually at > server startup. You can have it e.g. on a pendrive and start the server with > the keys as a backup. > > > > Am 17.06.2014 um 18:55 schrieb Roberto Spadim : > > humm, now i'm thinking as a data warehouse > think about installing a server (server 1) in somewhere (maybe saara > desert) i connect the "server 1" to internet, and configure the server > uri to point to my central server (server central), maybe at moon > > when the mysqld/mariadbd start, it will contact the central server and get > all keys, or only get keys when i need? for example a server with 1000 > tables and 1000 diferent keys, they are all stored at memory at boot time, > or only when i need read/write access to that table? > > if i remove the internet link, the "server 1" will not read tables, right? > in this case, if i have the keyfile in a pendrive, or a cd or dvd, could i > redirect it to a key file and start database, as a backup solution? > > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Week Four! - sample statements
good work guy :) i must agree links to MDEV are very wellcome 2014-06-18 8:31 GMT-03:00 James Briggs : > Hi Sriram. > > - I read your new blog and some of the test code. Looks good. > > - I think you should add a section to the MDEV with > examples of what the final syntax will look like > for each statement so we can check for standards > (ANSI and de facto) and esthetics. Looks correct to > me so far though - drop trigger if exists matches PG: > > http://www.postgresql.org/docs/9.3/static/sql-droptrigger.html > > Right now in the MDEV there's a feature matrix, > but no sample statements. > > Thanks, James. > > > On Tue, 6/17/14, sriram patil wrote: > > Subject: [Maria-developers] [GSoC] Week Four! > To: maria-developers@lists.launchpad.net > Date: Tuesday, June 17, 2014, 11:21 PM > > Hi All, > Sorry for a little delay in posting the blog link > this week. Following is the blog link about my fourth week > into GSoC. http://goo.gl/W54cvE > > Suggestions and/or reviews are welcome! > > Thanks,Sriram > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Commits] Rev 4257: Empty commit to check email setting in commit mails in http://bazaar.launchpad.net/~maria-captains/maria/10.0
working :) 2014-06-18 7:53 GMT-03:00 : > At http://bazaar.launchpad.net/~maria-captains/maria/10.0 > > > revno: 4257 > revision-id: kniel...@knielsen-hq.org-20140618105333-44ez01iye29sljur > parent: kniel...@knielsen-hq.org-20140618090308-frd0tuo8rycgyi32 > committer: Kristian Nielsen > branch nick: work-10.0 > timestamp: Wed 2014-06-18 12:53:33 +0200 > message: > Empty commit to check email setting in commit mails > ___ > commits mailing list > comm...@mariadb.org > https://lists.askmonty.org/cgi-bin/mailman/listinfo/commits > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] problem with update and myisam
the problem was the internet connection, now i'm with a better internet to test, sorry the results: with ()=() 5 seconds with field=const, 0,06seconds 2014-06-18 0:05 GMT-03:00 Roberto Spadim : > sorry guys, maybe i was a bit confuse > the solution of > field=const and field=const ... worked > > thanks, please close mdev-6355 > > > 2014-06-17 21:29 GMT-03:00 Roberto Spadim : > > No filesystem errors >> No hardware error >> No smartctl error >> Disk read test runs at constant180mb/s per disk (linux md raid 1) without >> problems (via dd if=disk1(2,3,4) of=/dev/null) >> No problema at mdstat >> Using xfs filesystem >> --- >> >> Im traveling now with time i will update database and check handler >> variables to see ehat happened >> >> >> >> >> Em terça-feira, 17 de junho de 2014, Roberto Spadim < >> robe...@spadim.com.br> escreveu: >> >> Hi guys >>> >>> Well thats a update at a field with a where with full primary key fields >>> >>> Where with >>> (Fields)=(consts) or >>> field=const and field=const ... >>> >>> Work the same way with same time >>> >>> >>> >>> Yes thats a bigint field (with int i got same problem) >>> the first partition is used for negative values >>> And others partitions to positive values >>> I'm running update only at negative values all others rows >>> (partitions) with positive value only have insert, no updates and no delete >>> >>> I'm using the primary key at where clausule in other words i'm using a >>> unique key or a unique index. I'm updating a field without indexes (a field >>> not indexed) >>> >>> I don't know why the mariadb stop 5 seconds or more, since it's a >>> partition with less than 1000 rows and no index field was changed >>> >>> >>> Any ideas? >>> >>> >>> >>> >>> >>> Em terça-feira, 17 de junho de 2014, James Briggs < >>> james.bri...@yahoo.com> escreveu: >>> >>>> Hi Roberto. >>>> >>>> 1) nf is a bigint, so why are you inserting a string value ('-18')? >>>> 2) is there some reason you aren't using indexes? >>>> 3) after you resolve 1 and 2, do repair table. >>>> >>>> Thanks, James. >>>> >>>> >>>> On Tue, 6/17/14, Roberto Spadim wrote: >>>> >>>> Subject: [Maria-developers] problem with update and myisam >>>> To: "maria-developers@lists.launchpad.net" < >>>> maria-developers@lists.launchpad.net> >>>> Date: Tuesday, June 17, 2014, 1:31 PM >>>> >>>> hi guys, could anyone >>>> help me with https://mariadb.atlassian.net/browse/MDEV-6355 >>>> thanks >>>> >>>> >>>> -- >>>> Roberto Spadim >>>> >>>> >>>> -Inline Attachment Follows- >>>> >>>> ___ >>>> Mailing list: https://launchpad.net/~maria-developers >>>> Post to : maria-developers@lists.launchpad.net >>>> Unsubscribe : https://launchpad.net/~maria-developers >>>> More help : https://help.launchpad.net/ListHelp >>>> >>>> >>> >>> -- >>> Roberto Spadim >>> SPAEmpresarial >>> Eng. Automação e Controle >>> >>> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> >> > > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] problem with update and myisam
sorry guys, maybe i was a bit confuse the solution of field=const and field=const ... worked thanks, please close mdev-6355 2014-06-17 21:29 GMT-03:00 Roberto Spadim : > No filesystem errors > No hardware error > No smartctl error > Disk read test runs at constant180mb/s per disk (linux md raid 1) without > problems (via dd if=disk1(2,3,4) of=/dev/null) > No problema at mdstat > Using xfs filesystem > --- > > Im traveling now with time i will update database and check handler > variables to see ehat happened > > > > > Em terça-feira, 17 de junho de 2014, Roberto Spadim > escreveu: > > Hi guys >> >> Well thats a update at a field with a where with full primary key fields >> >> Where with >> (Fields)=(consts) or >> field=const and field=const ... >> >> Work the same way with same time >> >> >> >> Yes thats a bigint field (with int i got same problem) >> the first partition is used for negative values >> And others partitions to positive values >> I'm running update only at negative values all others rows >> (partitions) with positive value only have insert, no updates and no delete >> >> I'm using the primary key at where clausule in other words i'm using a >> unique key or a unique index. I'm updating a field without indexes (a field >> not indexed) >> >> I don't know why the mariadb stop 5 seconds or more, since it's a >> partition with less than 1000 rows and no index field was changed >> >> >> Any ideas? >> >> >> >> >> >> Em terça-feira, 17 de junho de 2014, James Briggs >> escreveu: >> >>> Hi Roberto. >>> >>> 1) nf is a bigint, so why are you inserting a string value ('-18')? >>> 2) is there some reason you aren't using indexes? >>> 3) after you resolve 1 and 2, do repair table. >>> >>> Thanks, James. >>> >>> -------- >>> On Tue, 6/17/14, Roberto Spadim wrote: >>> >>> Subject: [Maria-developers] problem with update and myisam >>> To: "maria-developers@lists.launchpad.net" < >>> maria-developers@lists.launchpad.net> >>> Date: Tuesday, June 17, 2014, 1:31 PM >>> >>> hi guys, could anyone >>> help me with https://mariadb.atlassian.net/browse/MDEV-6355 >>> thanks >>> >>> >>> -- >>> Roberto Spadim >>> >>> >>> -Inline Attachment Follows- >>> >>> ___ >>> Mailing list: https://launchpad.net/~maria-developers >>> Post to : maria-developers@lists.launchpad.net >>> Unsubscribe : https://launchpad.net/~maria-developers >>> More help : https://help.launchpad.net/ListHelp >>> >>> >> >> -- >> Roberto Spadim >> SPAEmpresarial >> Eng. Automação e Controle >> >> > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] problem with update and myisam
No filesystem errors No hardware error No smartctl error Disk read test runs at constant180mb/s per disk (linux md raid 1) without problems (via dd if=disk1(2,3,4) of=/dev/null) No problema at mdstat Using xfs filesystem --- Im traveling now with time i will update database and check handler variables to see ehat happened Em terça-feira, 17 de junho de 2014, Roberto Spadim escreveu: > Hi guys > > Well thats a update at a field with a where with full primary key fields > > Where with > (Fields)=(consts) or > field=const and field=const ... > > Work the same way with same time > > > > Yes thats a bigint field (with int i got same problem) > the first partition is used for negative values > And others partitions to positive values > I'm running update only at negative values all others rows > (partitions) with positive value only have insert, no updates and no delete > > I'm using the primary key at where clausule in other words i'm using a > unique key or a unique index. I'm updating a field without indexes (a field > not indexed) > > I don't know why the mariadb stop 5 seconds or more, since it's a > partition with less than 1000 rows and no index field was changed > > > Any ideas? > > > > > > Em terça-feira, 17 de junho de 2014, James Briggs > escreveu: > >> Hi Roberto. >> >> 1) nf is a bigint, so why are you inserting a string value ('-18')? >> 2) is there some reason you aren't using indexes? >> 3) after you resolve 1 and 2, do repair table. >> >> Thanks, James. >> >> >> On Tue, 6/17/14, Roberto Spadim wrote: >> >> Subject: [Maria-developers] problem with update and myisam >> To: "maria-developers@lists.launchpad.net" < >> maria-developers@lists.launchpad.net> >> Date: Tuesday, June 17, 2014, 1:31 PM >> >> hi guys, could anyone >> help me with https://mariadb.atlassian.net/browse/MDEV-6355 >> thanks >> >> >> -- >> Roberto Spadim >> >> >> -Inline Attachment Follows- >> >> ___________ >> Mailing list: https://launchpad.net/~maria-developers >> Post to : maria-developers@lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-developers >> More help : https://help.launchpad.net/ListHelp >> >> > > -- > Roberto Spadim > SPAEmpresarial > Eng. Automação e Controle > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] problem with update and myisam
Hi guys Well thats a update at a field with a where with full primary key fields Where with (Fields)=(consts) or field=const and field=const ... Work the same way with same time Yes thats a bigint field (with int i got same problem) the first partition is used for negative values And others partitions to positive values I'm running update only at negative values all others rows (partitions) with positive value only have insert, no updates and no delete I'm using the primary key at where clausule in other words i'm using a unique key or a unique index. I'm updating a field without indexes (a field not indexed) I don't know why the mariadb stop 5 seconds or more, since it's a partition with less than 1000 rows and no index field was changed Any ideas? Em terça-feira, 17 de junho de 2014, James Briggs escreveu: > Hi Roberto. > > 1) nf is a bigint, so why are you inserting a string value ('-18')? > 2) is there some reason you aren't using indexes? > 3) after you resolve 1 and 2, do repair table. > > Thanks, James. > > ---- > On Tue, 6/17/14, Roberto Spadim > > wrote: > > Subject: [Maria-developers] problem with update and myisam > To: "maria-developers@lists.launchpad.net " < > maria-developers@lists.launchpad.net > > Date: Tuesday, June 17, 2014, 1:31 PM > > hi guys, could anyone > help me with https://mariadb.atlassian.net/browse/MDEV-6355 > thanks > > > -- > Roberto Spadim > > > -Inline Attachment Follows- > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
[Maria-developers] problem with update and myisam
hi guys, could anyone help me with https://mariadb.atlassian.net/browse/MDEV-6355 thanks -- Roberto Spadim ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
>> ma_key_recover.c | 10 >> ma_loghandler.c | 63 +--- >> ma_open.c | 48 ++- >> ma_pagecache.c| 154 ++--- >> ma_pagecache.h| 34 +- >> ma_pagecrc.c | 118 --- >> ma_static.c |1 >> ma_write.c| 24 - >> maria_def.h | 81 ++--- >> unittest/ma_pagecache_consist.c | 28 - >> unittest/ma_pagecache_rwconsist.c | 27 - >> unittest/ma_pagecache_rwconsist2.c| 27 - >> unittest/ma_pagecache_single.c| 27 - >> unittest/ma_test_loghandler_pagecache-t.c | 29 - >> 26 files changed, 1102 insertions(+), 507 deletions(-) >> >> A noticeable difference between innodb and maria is that we didn't >> implement encryption of the log for maria, >> as we only added support for temporary tables. For maria we also only >> added encryption support for BLOCK format >> but added all the features to this format so that it was usable for all >> temp-table scenarios. maria also doesn't have >> key-rotation feature like innodb has. >> >> I couldn't (as) easily extract diffstats for binlog and tempfile >> encryption. >> You have to wait for the code to get published... >> >> >> On Tue, Jun 17, 2014 at 7:29 AM, Elmar Eperiesi-Beck < >> el...@eperiesi-beck.de> wrote: >> >>> Hi, >>> by "interfaces" I was looking for the Maria DB place/ function / hook... >>> where you are enhancing the MariaDB Code. >>> This would help me to understand what you are trying to do. >>> >>> Elmar >>> >>> Am 17.06.2014 um 07:02 schrieb Jonas Oreland : >>> >>> Hi again, >>> >>> > What is the type of license of your code? >>> >>> I asked internally about license, and it seems like we releasing dual >>> gpl2/apache licensed code. >>> >>> > I would like to know, which interfaces from maria-DB you are using. >>> >>> I don't 100% understand the question. >>> We didn't write any actual encryption code, but used the one provided in >>> openssl. >>> Other than that, we didn't really "use interfaces", but rather >>> added/modified functionality/interfaces here and there. >>> >>> Can you be more specific ? >>> >>> /Jonas >>> >>> >>> >>> On Sat, Jun 7, 2014 at 11:20 PM, Elmar Eperiesi-Beck < >>> el...@eperiesi-beck.de> wrote: >>> >>>> Hi! >>>> We (eperi) would be glad to do a joined work with Google. >>>> Our solution works with MS-SQL, Oracle and other DBs and we are >>>> currently porting it to MariaDB - and - as Monty said - its never to late >>>> to put some sources together and make the best for the open source >>>> community. >>>> >>>> What is the type of license of your code? >>>> >>>> Jonas, I am looking forward to connect to you directly. >>>> >>>> Regards >>>> Elmar >>>> >>>> Hi! >>>> >>>> > Hi Jonas, >>>> > (same Jonas we know from NDBCLUSTER? :-) Good to see you again) >>>> > >>>> > On 6 Jun 2014, at 02:31, Jonas Oreland wrote: >>>> > >>>> >> Hi there, >>>> >> I read this blog post >>>> >> >>>> http://monty-says.blogspot.com/2014/05/for-your-eyes-only-or-adding-better.html >>>> >> and wanted to inform you that we at Google has developed >>>> on-disk/block-level encryption for Innodb, aria (as used by temporary >>>> tables), binlogs and temp-files. >>>> >> The code is not yet published, but we expect it to be within a few >>>> weeks or so. >>>> >> We (of course?) think that it would be better if you instead of >>>> developing new code >>>> >> spent the time testing/reviewing ours. >>>> >>>> We are out course happy to do this! >>>> >>>> >> I'm happy to answer questions on the topic, >>>> >> and will let you know once we've published it. >>>> >>>> The main question I have about the Innodb encryption is if it based on >>>> the compression code we did for fusion-io? >>>> The idea we had on our side was that by using the new compression hooks >>>> we could add encryption with very little changes to the Innodb code. >>>> Looking forward to when you are ready to publish the code so we can >>>> discuss your changes in detail. >>>> >>>> > This is great news! >>>> > >>>> > From what I gather, from Monty's blog post (and a 1:1 we had some >>>> time back), this is something done by a partner/external company that has a >>>> mostly OSS solution, that we should integrate into 10.1 >>>> >>>> Yes, that's correct. It I would have known that Google was working on >>>> encryption I would have included them in my discussions with eperi. >>>> Fortunately it's not yet too late to do this. >>>> I am sure eperi would like to work on the Google code as a base! >>>> >>>> > That said, Google's release of something that works for InnoDB, Aria, >>>> binlogs, temp files (and presumably not too hard to add for MyISAM) is >>>> something we should definitely review and target for 10.1 >>>> >>>> Yes! >>>> >>>> Regards, >>>> Monty >>>> >>>> >>>> >>> >> >> > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
humm, now i'm thinking as a data warehouse think about installing a server (server 1) in somewhere (maybe saara desert) i connect the "server 1" to internet, and configure the server uri to point to my central server (server central), maybe at moon when the mysqld/mariadbd start, it will contact the central server and get all keys, or only get keys when i need? for example a server with 1000 tables and 1000 diferent keys, they are all stored at memory at boot time, or only when i need read/write access to that table? if i remove the internet link, the "server 1" will not read tables, right? in this case, if i have the keyfile in a pendrive, or a cd or dvd, could i redirect it to a key file and start database, as a backup solution? ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [Maria-discuss] MariaDB encryption
d help me to understand what you are trying to do. >> >> Elmar >> >> Am 17.06.2014 um 07:02 schrieb Jonas Oreland : >> >> Hi again, >> >> > What is the type of license of your code? >> >> I asked internally about license, and it seems like we releasing dual >> gpl2/apache licensed code. >> >> > I would like to know, which interfaces from maria-DB you are using. >> >> I don't 100% understand the question. >> We didn't write any actual encryption code, but used the one provided in >> openssl. >> Other than that, we didn't really "use interfaces", but rather >> added/modified functionality/interfaces here and there. >> >> Can you be more specific ? >> >> /Jonas >> >> >> >> On Sat, Jun 7, 2014 at 11:20 PM, Elmar Eperiesi-Beck < >> el...@eperiesi-beck.de> wrote: >> >>> Hi! >>> We (eperi) would be glad to do a joined work with Google. >>> Our solution works with MS-SQL, Oracle and other DBs and we are >>> currently porting it to MariaDB - and - as Monty said - its never to late >>> to put some sources together and make the best for the open source >>> community. >>> >>> What is the type of license of your code? >>> >>> Jonas, I am looking forward to connect to you directly. >>> >>> Regards >>> Elmar >>> >>> Hi! >>> >>> > Hi Jonas, >>> > (same Jonas we know from NDBCLUSTER? :-) Good to see you again) >>> > >>> > On 6 Jun 2014, at 02:31, Jonas Oreland wrote: >>> > >>> >> Hi there, >>> >> I read this blog post >>> >> >>> http://monty-says.blogspot.com/2014/05/for-your-eyes-only-or-adding-better.html >>> >> and wanted to inform you that we at Google has developed >>> on-disk/block-level encryption for Innodb, aria (as used by temporary >>> tables), binlogs and temp-files. >>> >> The code is not yet published, but we expect it to be within a few >>> weeks or so. >>> >> We (of course?) think that it would be better if you instead of >>> developing new code >>> >> spent the time testing/reviewing ours. >>> >>> We are out course happy to do this! >>> >>> >> I'm happy to answer questions on the topic, >>> >> and will let you know once we've published it. >>> >>> The main question I have about the Innodb encryption is if it based on >>> the compression code we did for fusion-io? >>> The idea we had on our side was that by using the new compression hooks >>> we could add encryption with very little changes to the Innodb code. >>> Looking forward to when you are ready to publish the code so we can >>> discuss your changes in detail. >>> >>> > This is great news! >>> > >>> > From what I gather, from Monty's blog post (and a 1:1 we had some time >>> back), this is something done by a partner/external company that has a >>> mostly OSS solution, that we should integrate into 10.1 >>> >>> Yes, that's correct. It I would have known that Google was working on >>> encryption I would have included them in my discussions with eperi. >>> Fortunately it's not yet too late to do this. >>> I am sure eperi would like to work on the Google code as a base! >>> >>> > That said, Google's release of something that works for InnoDB, Aria, >>> binlogs, temp files (and presumably not too hard to add for MyISAM) is >>> something we should definitely review and target for 10.1 >>> >>> Yes! >>> >>> Regards, >>> Monty >>> >>> >>> >> > > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] Allow to turn off max_connect_errors
maybe a null value? 2014-06-09 12:14 GMT-03:00 Honza Horak : > Hi guys, > > there are apparently some tools out there [1], that check if the server is > up quite often, while not closing the connection properly. It eventually > ends in 'many connection errors', because max_connect_errors is always > limited now. > > I understand that this way of checking may be wrong, but there may be > scenarios where we do not want to check for `max_connect_errors` at all. > > So, would it be acceptable for mariadb to change behaviour of > max_connect_errors option, so that it accepts also 0 as a possible value, > which would mean 'do not check connect errors at all'? > > I'm bringing the idea here first, but will submit a report and possibly > patch if it does not seem to be undesired behaviour. > > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1104957 > > TIA and regards, > Honza > > ___ > Mailing list: https://launchpad.net/~maria-developers > Post to : maria-developers@lists.launchpad.net > Unsubscribe : https://launchpad.net/~maria-developers > More help : https://help.launchpad.net/ListHelp > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp
Re: [Maria-developers] [GSoC] Introduction Mail
Well i wws reading your posts Do you need big data to test read and scan times? Em segunda-feira, 9 de junho de 2014, Anshu Avinash < anshu.avinas...@gmail.com> escreveu: > Hi all, > > You can find this week's blog entry at > http://igniting.in/gsoc2014/2014/06/09/more-coding/. I'm now maintaining > the code only on github: > https://github.com/igniting/server/tree/selfTuningOptimizer. > > Regards > Anshu Avinash > > > On Sun, May 25, 2014 at 3:27 PM, Anshu Avinash > wrote: > > Hi all, > > You can find my this week's blog entry at > http://igniting.in/gsoc2014/2014/05/25/coding-things-up/ . I have created > a branch on launchpad for my work: > http://bazaar.launchpad.net/~igniting/maria/maria/revision/4211 . You can > give your suggestions/reviews either on this thread or as a comment on the > blog itself. > > Regards > Anshu Avinash > > > On Tue, May 20, 2014 at 1:22 AM, Roberto Spadim > wrote: > > wow a big work, congratulation guy, i will read part by part > to better understand mariadb code > > > 2014-05-19 16:33 GMT-03:00 Anshu Avinash : > > Hi all, > > This week's blog entry would get delayed by couple of days. I have started > coding though and would like to give heads up on what I'm doing. > > I've looked at the diffs for "Cost model project" of mysql: > http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7596 and > http://bazaar.launchpad.net/~mysql/mysql-server/5.7/revision/7222 . These > give a pretty good idea about what are the hard-coded constants and where > are they being used. > > The idea is to multiply "READ_TIME_FACTOR" and "SCAN_TIME_FACTOR" to the > values returned by read_time() and scan_time() in handler.h, while > returning. These values would be read from a table in mysql db. For that > I've looked at sql_statistics.cc. After completing this, I'll first change > the values of these constants manually and check if the better or worse > query plans are being selected. I'll first do the last step manually, to > check if everything is working as expected and later automate it. > > Regards > Anshu > > > On Mon, May 12, 2014 at 11:22 AM, Anshu Avinash > wrote: > > Hi all, > > You can find my blog entry for this week at > http://igniting.in/gsoc2014/2014/05/11/first-steps/ . > > Regards > Anshu Avinash > > > On Thu, May 8, 2014 at 11:46 PM, Anshu Avinash > wrote: > > Hi all, > > Sorry for the irregular updates. I had been busy for last couple of days > and might still be busy for 1-2 days more. I would be completely free > starting next week, and would be updating my blog weekly on every Monday > (so 1st update would be on May 12). I would also send the link of my post > weekly on the mailing list. > > As discussed on irc, I started to explore the pair of constants: > handler::scan_time() and handler::read_time(). > > -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle ___ Mailing list: https://launchpad.net/~maria-developers Post to : maria-developers@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-developers More help : https://help.launchpad.net/ListHelp