Drizzle

Alter 'make test' to use dtr's --mem option

Bug #675755 reported by Patrick Crews
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Drizzle
Fix Released
Medium
Patrick Crews
Drizzle 2011-01-31
7.0
Fix Released
Medium
Patrick Crews
Drizzle 2011-01-31

Bug Description

Using the --mem option will allow our test suite to run *much* faster - 615s vs. 2252s on average.

We need to alter tests/include.am + test files + test-run.pl as needed to make this happen.

Related branches

lp:~patrick-crews/drizzle/make-test-mem
lp:~patrick-crews/drizzle/project_steve_austin
Patrick Crews: Needs Resubmitting
Lee Bieber (community): Needs Fixing
Diff: 4137 lines (+3158/-95)
87 files modified
.bzrignore (+1/-0)
plugin/filesystem_engine/tests/r/basic_create_table.result (+6/-6)
plugin/filesystem_engine/tests/r/basic_delete.result (+1/-1)
plugin/filesystem_engine/tests/r/basic_insert.result (+1/-1)
plugin/filesystem_engine/tests/r/basic_select.result (+1/-1)
plugin/filesystem_engine/tests/r/basic_update.result (+1/-1)
plugin/filesystem_engine/tests/r/multiple_update.result (+1/-1)
plugin/filesystem_engine/tests/r/rnd_pos.result (+1/-1)
plugin/filesystem_engine/tests/r/select_big_file.result (+1/-1)
plugin/filesystem_engine/tests/r/select_chop_line.result (+1/-1)
plugin/filesystem_engine/tests/r/select_cpuinfo.result (+2/-2)
plugin/filesystem_engine/tests/r/select_meminfo.result (+2/-2)
plugin/filesystem_engine/tests/r/select_separator_mode_weak.result (+1/-1)
plugin/filesystem_engine/tests/r/select_short_line.result (+1/-1)
plugin/filesystem_engine/tests/r/select_skip_blank_line.result (+1/-1)
plugin/filesystem_engine/tests/r/select_with_escaped_character.result (+1/-2)
plugin/filesystem_engine/tests/r/select_with_omit_field.result (+1/-1)
plugin/filesystem_engine/tests/r/select_with_separators.result (+1/-1)
plugin/filesystem_engine/tests/t/basic_create_table.test (+11/-5)
plugin/filesystem_engine/tests/t/basic_delete.test (+2/-1)
plugin/filesystem_engine/tests/t/basic_insert.test (+2/-1)
plugin/filesystem_engine/tests/t/basic_select.test (+2/-1)
plugin/filesystem_engine/tests/t/basic_update.test (+2/-1)
plugin/filesystem_engine/tests/t/multiple_update.test (+2/-1)
plugin/filesystem_engine/tests/t/rnd_pos.test (+3/-2)
plugin/filesystem_engine/tests/t/select_big_file.test (+2/-1)
plugin/filesystem_engine/tests/t/select_chop_line.test (+2/-1)
plugin/filesystem_engine/tests/t/select_cpuinfo.test (+3/-1)
plugin/filesystem_engine/tests/t/select_meminfo.test (+3/-1)
plugin/filesystem_engine/tests/t/select_separator_mode_weak.test (+2/-1)
plugin/filesystem_engine/tests/t/select_short_line.test (+2/-1)
plugin/filesystem_engine/tests/t/select_skip_blank_line.test (+2/-1)
plugin/filesystem_engine/tests/t/select_with_escaped_character.test (+2/-2)
plugin/filesystem_engine/tests/t/select_with_omit_field.test (+3/-2)
plugin/filesystem_engine/tests/t/select_with_separators.test (+3/-2)
plugin/filtered_replicator/tests/t/var_filteredschemas.test (+2/-1)
plugin/filtered_replicator/tests/t/var_filteredtables.test (+2/-2)
plugin/filtered_replicator/tests/t/var_schemaregex.test (+2/-1)
plugin/filtered_replicator/tests/t/var_tableregex.test (+2/-2)
plugin/innobase/tests/t/innodb_bug53756-master.opt (+0/-1)
plugin/storage_engine_api_tester/tests/t/txn_log_insert.test (+2/-2)
plugin/storage_engine_api_tester/tests/t/txn_log_rollback_large_stmt.test (+2/-1)
plugin/transaction_log/tests/r/truncate_log.result (+2/-2)
plugin/transaction_log/tests/t/alter.test (+2/-2)
plugin/transaction_log/tests/t/alter_schema.test (+2/-1)
plugin/transaction_log/tests/t/auto_commit.test (+2/-1)
plugin/transaction_log/tests/t/blob.test (+2/-1)
plugin/transaction_log/tests/t/create_select.test (+2/-1)
plugin/transaction_log/tests/t/create_table.test (+2/-1)
plugin/transaction_log/tests/t/delete.test (+2/-1)
plugin/transaction_log/tests/t/embedded_quotes.test (+2/-1)
plugin/transaction_log/tests/t/insert.test (+2/-1)
plugin/transaction_log/tests/t/insert_multi.test (+2/-1)
plugin/transaction_log/tests/t/insert_on_duplicate_update.test (+2/-1)
plugin/transaction_log/tests/t/insert_select.test (+2/-1)
plugin/transaction_log/tests/t/multi_column_primary_key.test (+2/-1)
plugin/transaction_log/tests/t/multi_table.test (+2/-1)
plugin/transaction_log/tests/t/no_modification.test (+2/-1)
plugin/transaction_log/tests/t/no_primary_key.test (+2/-1)
plugin/transaction_log/tests/t/null_values.test (+2/-1)
plugin/transaction_log/tests/t/rand.test (+2/-1)
plugin/transaction_log/tests/t/rename.test (+2/-1)
plugin/transaction_log/tests/t/replace.test (+2/-1)
plugin/transaction_log/tests/t/rollback.test (+2/-1)
plugin/transaction_log/tests/t/rollback_statement.test (+4/-3)
plugin/transaction_log/tests/t/schema.test (+2/-1)
plugin/transaction_log/tests/t/select_for_update.test (+2/-1)
plugin/transaction_log/tests/t/temp_tables.test (+2/-2)
plugin/transaction_log/tests/t/truncate.test (+2/-1)
plugin/transaction_log/tests/t/truncate_log.test (+4/-2)
plugin/transaction_log/tests/t/update.test (+2/-1)
tests/dbqp.py (+72/-0)
tests/include.am (+4/-0)
tests/lib/drizzle_test_run/dtr_test_execution.py (+159/-0)
tests/lib/drizzle_test_run/dtr_test_management.py (+393/-0)
tests/lib/server_mgmt/drizzled.py (+269/-0)
tests/lib/server_mgmt/server_management.py (+299/-0)
tests/lib/sys_mgmt/codeTree.py (+151/-0)
tests/lib/sys_mgmt/logging_management.py (+103/-0)
tests/lib/sys_mgmt/port_management.py (+172/-0)
tests/lib/sys_mgmt/system_management.py (+438/-0)
tests/lib/sys_mgmt/time_management.py (+103/-0)
tests/lib/test_mgmt/execution_management.py (+121/-0)
tests/lib/test_mgmt/test_execution.py (+145/-0)
tests/lib/test_mgmt/test_management.py (+264/-0)
tests/lib/test_mode.py (+45/-0)
tests/lib/test_run_options.py (+273/-0)
Revision history for this message
Patrick Crews (patrick-crews) wrote :

http://docs.drizzle.org/testing/test-run.html#cmdoption--mem

Changed in drizzle:
status: New → Confirmed
importance: Undecided → Medium
assignee: nobody → Patrick Crews (patrick-crews)
Revision history for this message
Stewart Smith (stewart) wrote : Re: [Bug 675755] [NEW] Alter 'make test' to use dtr's --mem option

On Mon, 15 Nov 2010 21:29:28 -0000, Patrick Crews <email address hidden> wrote:
> Using the --mem option will allow our test suite to run *much* faster -
> 615s vs. 2252s on average.

libeatmydata?

--
Stewart Smith

Revision history for this message
Patrick Crews (patrick-crews) wrote :

https://bugs.launchpad.net/drizzle/+bug/675777
Making that a separate bug. We already have 99% of what we need to have
make test working with mem and can speed life up a bit.

libeatmydata is on the radar, but I wanted to get the working bits in there
and build on them : )

On Mon, Nov 15, 2010 at 9:02 PM, Stewart Smith <email address hidden>wrote:

> On Mon, 15 Nov 2010 21:29:28 -0000, Patrick Crews <
> <email address hidden>> wrote:
> > Using the --mem option will allow our test suite to run *much* faster -
> > 615s vs. 2252s on average.
>
> libeatmydata?
>
> --
> Stewart Smith
>
> --
> Alter 'make test' to use dtr's --mem option
> https://bugs.launchpad.net/bugs/675755
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in A Lightweight SQL Database for Cloud Infrastructure and Web
> Applications: Confirmed
>
> Bug description:
> Using the --mem option will allow our test suite to run *much* faster -
> 615s vs. 2252s on average.
>
> We need to alter tests/include.am + test files + test-run.pl as needed to
> make this happen.
>
> To unsubscribe from this bug, go to:
> https://bugs.launchpad.net/drizzle/+bug/675755/+subscribe
>

Patrick Crews (patrick-crews)
Changed in drizzle:
status: Confirmed → Fix Committed
Revision history for this message
Patrick Crews (patrick-crews) wrote :

Linked branch contains python test-runner implementation.
By default, we try to symlink our workdir to a shm location, and failover to normal file system if we can't find anything

./test-run.py --suite=main update key
13 Jan 2011 12:57:52 INFO: Using Drizzle source tree:
13 Jan 2011 12:57:52 INFO: basedir: drizzle
13 Jan 2011 12:57:52 INFO: clientbindir: drizzle/client
13 Jan 2011 12:57:52 INFO: testdir: drizzle/tests
13 Jan 2011 12:57:52 INFO: server_version: 2011.01.2070
13 Jan 2011 12:57:52 INFO: server_compile_os: unknown-linux-gnu
13 Jan 2011 12:57:52 INFO: server_platform: x86_64
13 Jan 2011 12:57:52 INFO: server_comment: (Source distribution (drizzle-build))
13 Jan 2011 12:57:52 INFO: Linking workdir drizzle/tests/dtr_work to /dev/shm/dtr_work_sym

Patrick Crews (patrick-crews)
Changed in drizzle:
milestone: none → future
Revision history for this message
Lee Bieber (kalebral-deactivatedaccount) wrote :

Fixed in new python based test runner

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.